-- Logs begin at Thu 2022-07-28 01:17:09 UTC, end at Thu 2022-07-28 02:32:23 UTC. -- Jul 28 01:54:31.270250 dv-cinder-799871-46-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 01:54:31.278166 dv-cinder-799871-46-smb devstack@keystone.service[80060]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 01:54:31 2022] *** Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: nodename: dv-cinder-799871-46-smb Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: machine: x86_64 Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: clock source: unix Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: pcre jit disabled Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: detected number of CPU cores: 4 Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: current working directory: / Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: detected binary path: /usr/bin/uwsgi-core Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: your processes number limit is 47680 Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: your memory page size is 4096 bytes Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: detected max file descriptor number: 2048 Jul 28 01:54:31.281281 dv-cinder-799871-46-smb devstack@keystone.service[80060]: lock engine: pthread robust mutexes Jul 28 01:54:31.281991 dv-cinder-799871-46-smb devstack@keystone.service[80060]: thunder lock: enabled Jul 28 01:54:31.281991 dv-cinder-799871-46-smb devstack@keystone.service[80060]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 01:54:31.281991 dv-cinder-799871-46-smb devstack@keystone.service[80060]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 01:54:31.320318 dv-cinder-799871-46-smb devstack@keystone.service[80060]: Python main interpreter initialized at 0x55ac259989c0 Jul 28 01:54:31.320318 dv-cinder-799871-46-smb devstack@keystone.service[80060]: python threads support enabled Jul 28 01:54:31.320318 dv-cinder-799871-46-smb devstack@keystone.service[80060]: your server socket listen backlog is limited to 100 connections Jul 28 01:54:31.320318 dv-cinder-799871-46-smb devstack@keystone.service[80060]: your mercy for graceful operations on workers is 90 seconds Jul 28 01:54:31.320696 dv-cinder-799871-46-smb devstack@keystone.service[80060]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 01:54:31.320758 dv-cinder-799871-46-smb devstack@keystone.service[80060]: *** Operational MODE: preforking *** Jul 28 01:54:31.321011 dv-cinder-799871-46-smb devstack@keystone.service[80060]: *** uWSGI is running in multiple interpreter mode *** Jul 28 01:54:31.321011 dv-cinder-799871-46-smb devstack@keystone.service[80060]: spawned uWSGI master process (pid: 80060) Jul 28 01:54:31.321229 dv-cinder-799871-46-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 01:54:31.323879 dv-cinder-799871-46-smb devstack@keystone.service[80060]: spawned uWSGI worker 1 (pid: 80076, cores: 1) Jul 28 01:54:31.323879 dv-cinder-799871-46-smb devstack@keystone.service[80060]: spawned uWSGI worker 2 (pid: 80077, cores: 1) Jul 28 01:54:31.323879 dv-cinder-799871-46-smb devstack@keystone.service[80060]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 01:54:36.806011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:54:36.806011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: from cryptography.utils import int_from_bytes Jul 28 01:54:36.807386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:54:36.807386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: from cryptography.utils import int_from_bytes Jul 28 01:54:36.807788 dv-cinder-799871-46-smb devstack@keystone.service[80077]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:54:36.807788 dv-cinder-799871-46-smb devstack@keystone.service[80077]: from cryptography.utils import int_from_bytes Jul 28 01:54:36.807887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:54:36.807887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: from cryptography.utils import int_from_bytes Jul 28 01:54:36.856555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 01:54:36.856716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 01:54:36.856716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 01:54:36.856862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 01:54:36.856923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] command line args: [] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 01:54:36.856983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] command line args: [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 01:54:36.857167 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 01:54:36.857254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 01:54:36.857330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ================================================================================ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 01:54:36.857399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ================================================================================ {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 01:54:36.857577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] admin_token = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.857660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] admin_token = **** {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.857813 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] config_dir = [] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.857896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] config_dir = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.857997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.858074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.858174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] config_source = [] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.858255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] config_source = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.858336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] debug = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.858406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] debug = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.858630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.858875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.858970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.859035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.859137 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.859214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.859384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.859465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.859630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.859703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.859856 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] list_limit = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.859929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_config_append = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] log_config_append = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] log_dir = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_dir = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] log_file = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.860988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.861092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.861222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.861358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.861456 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.861556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.861661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.861759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.862023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.862133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.862267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.862374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.862498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.862639 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.862749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.862850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.862984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.863089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.863188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.863291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.863437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.863542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.863645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.863755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.863828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.863898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.863969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.864039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.864327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.864421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.864499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] publish_errors = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.864575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] publish_errors = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.864726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.864812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.864955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.865078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.865147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.865215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.865404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.865513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.865587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.865654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.865844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] standard_threads = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.865942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] standard_threads = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] use_journal = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] use_journal = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] use_json = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866861 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] use_json = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866924 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] use_stderr = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.866984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] use_stderr = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.867095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] use_syslog = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.867199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] use_syslog = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.867320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.867407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:54:36.867571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.867657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.867806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.867897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.868061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.868146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.868296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.868380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.868540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.868640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.868773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.868851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.869542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.869628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.869777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.869855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.870022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.870105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.870264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.870379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.870534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.870621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.870765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.870843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.871007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.871085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.871238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.871317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.871479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.871556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.871719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.871796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.871966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.872037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.872194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.872353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.872426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.872484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.872669 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.872750 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.872900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.872979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.873147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.873226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.873405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.873484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.873651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.873729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.873892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.873985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.874118 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.874206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.874347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.874425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.874599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.874687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.874832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.874917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.875081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.875167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.875322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.875455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.875574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.875693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.875809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.875924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.876038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.876166 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.876290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.876405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.876521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.876635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.876748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.876874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.876991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.877111 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.877227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.877341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.877456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878094 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.878954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.879998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.880079 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.880227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.880337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.880462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.880599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.880716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.880821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.880932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.881030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.881156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.881293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.881442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.881521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.881638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.881715 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.881830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.881906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.882034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.882123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.882236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.882325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.882501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.882603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.882746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.882828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.882976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.883056 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.883204 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.883287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.883438 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.883516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.883672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.883754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.883933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.884010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.884167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.884252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.884410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.884533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.884703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.885307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.885463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.885552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.885697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.885823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.885932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.886016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.886175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.886264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.886412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.886547 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.886672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.886752 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.886909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.887001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.887143 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.887224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.887380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.887461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.887610 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.887697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.887843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.887928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.888151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.888329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.888417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.888566 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.888644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.888803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.888881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.889038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.889199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.889274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.889398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.889483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.889556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.889717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.889805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.889949 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.890045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.890177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.890256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.890403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.890533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.890655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.890746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.890885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.890964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.891112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.891198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.891346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.891433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.891577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.891655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.891818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.891906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.892051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.892138 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.892302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.892387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.892555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.892633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.892791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.892877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.893021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.external = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.893099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] auth.external = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.893249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.893327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.893538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.893647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.893766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.893854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.893993 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] auth.password = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.894072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.password = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.894221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.token = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.894300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] auth.token = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.894469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.894553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.894706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.894786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.894949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.895028 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.895175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.895264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.895422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.895503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.895666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.895745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.895894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.895975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.896125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] credential.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.896203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.896370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.896449 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.896613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.896702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.896857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.896938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.897093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.897336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.897423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.897570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.897650 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.897832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.897911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.898083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.898170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.898319 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.898400 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.898591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.898672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.898843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.898936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.899110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.899189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.899359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.899438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.899604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.899691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.899857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.899938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.900089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.900175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.900356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] federation.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.900443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.900592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.900673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.900835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.900915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.901063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.901157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.901294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.901378 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.901534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.901613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.901768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.901858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.902010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.902090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.902242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.902321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.902508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.902607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.902743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.902823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.902988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.903066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.903219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.903375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.903452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.903532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.903694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.903774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.903925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.904005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.904158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.904238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.904387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.904466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.904617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.904697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.904853 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.904933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.905099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.905185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.905336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.905417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.905566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.905646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.905793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.905873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.906018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.906098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.906260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.906340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.906527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.906608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.906772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.906853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.907020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.907099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.907261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.907340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.907525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.907629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.907759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.907867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.907987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.908066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.908215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.908296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.908444 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.908522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.908670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.908755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.908903 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.908986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.909140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.909220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.909375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.909455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.909607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.909677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.909835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.909903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.910079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.910148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.910311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.910380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.910568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.910641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.910815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.911047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.911286 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.911516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.911754 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.911834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.911992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.912072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.912235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.912317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.912473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.912555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.912710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.912958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.913191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.913274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.913423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.913509 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.913654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.913734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.913902 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.913984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.914149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.914236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.914385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.914509 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.914647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.914883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.915115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.915360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.915619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.915869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.915978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.916120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.916260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.916365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.916513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.916614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.916763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.916845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.917025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.917199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.917280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.917361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.917507 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.917588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.917743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.917823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.917974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.918062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.918220 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.918504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.918731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.919104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.919355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.919588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.919837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.919937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.920074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.920189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.920313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.920458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.920542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.920697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.920777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.920950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.921029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.921201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.921282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.921469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.921548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.921723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.921803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.921954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.922036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.922189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.922268 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.922422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.922514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.922677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.922759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.922910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.922989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.923153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.923232 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.923395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.923477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.923628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.923708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.923865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.923998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.924107 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.924250 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.924357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.924485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.924604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.924735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.924823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.924974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.925074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.925210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.925330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.925446 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.925565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.925682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.925811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.925927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.926050 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.926173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.926289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.926411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.926545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] role.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.926688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.926791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] role.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.926917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.927010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.927161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.927241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.927397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.927485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.927630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.927719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.927867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.927948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.928112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.928194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.928353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.928512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.928589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.928663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.928808 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.928889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.929046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] resource.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.929135 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.929295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.929376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.929542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.929622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.929775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.929863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.930029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.930109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.930283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.930475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.930574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.930715 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.930795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.930967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.931051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.931212 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.931299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.931447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] role.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.932030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.932217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] role.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.932297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.932447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.932535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.932695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.932776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.932942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.933022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.933179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.933267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.933410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.933490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.933641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.933720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.933872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.933960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.934116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.934195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.934361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.934479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.934616 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.934708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.934856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.934935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.935091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.935170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.935320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.935408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.935553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.935634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.935794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.935978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.936058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.936214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.936296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.936464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.936544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.936712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.936792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.936956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.937037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.937200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.937279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.937433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.937521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.937676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.937755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.937914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.938000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.938148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.938235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.938376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.938476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.938644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.938723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.938872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.938963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.939110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.939189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.939603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.939684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.939846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.939934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.940080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.940161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.940316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.940406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.940544 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.940625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.940776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] token.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.940864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.941011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.941091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.941255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.941374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.941474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.941563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.941726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.941806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.941963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.942044 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.942196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.942283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.942432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.942568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.942697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.942777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.942932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.943031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.943166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.943246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.943403 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.943482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.943631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.943719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.943869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.943949 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.944110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.944190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.944333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.944426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.944502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 01:54:36.944573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.944849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.945107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.connection = **** {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.945351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.945596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.945830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.946069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.946301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.946560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.946798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.947032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.947826 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.948063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.948306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.948539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.948783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.949017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.949260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.949489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.949727 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.949960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:54:36.950128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 01:54:36.973794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:36.974022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:36.974244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:36.975162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:36.975394 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:36.975619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:36.982613 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:36.983887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.013054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.013272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.014009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.014239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.066085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.066244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.116678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.116913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.117399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.117640 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.180723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.180949 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.181036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.181174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.181274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.181391 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.181474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.182158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.182284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.182382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.182498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.182583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.205295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.205536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.205654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.205756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.205889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.205974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.206116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.206208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.206340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.206423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.206667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.206798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.207011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.217740 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.218036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.230973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.231201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.231420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.231504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.231636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.231720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.231848 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.231940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.232060 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.232142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.232268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.232350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.232537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.232751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 01:54:37.249573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.249782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 01:54:37.249917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.250112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.250211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 01:54:37.250315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 01:54:37.250472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.250608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.250691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 01:54:37.250864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.250958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.251117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.251199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.251365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.251446 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.251648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.261070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.261339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.261484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.261602 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.261757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.261877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.262024 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.262296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.268776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.269311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.273587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.273916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.274089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.274198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.274369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.274487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.274679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.274830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.274962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.275141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.275279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.275465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.275548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.275747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.275829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.276015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.276106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.276286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.276369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.276550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.276632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.276813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.300054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.300307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.301530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.301792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.301891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.302069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.306395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.307242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.307335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.307523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.307620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.307836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.314054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.314610 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.314700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.314965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.318815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.319059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.319340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.319423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.319612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.319697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.319878 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.319961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.320153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.320236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.320416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.320500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.320684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.320766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.320982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.321259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.336566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.336838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.337243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.337520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.340798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.341494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.343941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.344238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.344640 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.344943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.348614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.349349 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.351799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.352563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.355474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.355765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.356046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.356256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.356340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.356555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.356659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.356840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.356924 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.357132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.357422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.357707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.373348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.373622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.373882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.374140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.374234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.374518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.374784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.375043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.381018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.381944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.382575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.382847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.383540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.383814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.385680 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.385954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.386244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.386546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.386688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.386832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.386965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.387259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.387540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.387824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.398223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.398527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.398806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.399083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.399275 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.399366 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.399555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.399638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.399828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.399911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.400102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.400399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.400672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.400944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.415331 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.417080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.418833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.420083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.421744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.423069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.424419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.425502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.425953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.426228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.426525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.427048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.427335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.427639 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.433604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.434746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.435205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.436343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.438103 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.438388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.438699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.438973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.439557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.439844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.440126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.440395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.447382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.447528 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.447804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.448477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.448760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.449040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.454639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.454915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.455191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.455460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.455741 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.455949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 01:54:37.456032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.456226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.456322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.456502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.456649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.456770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.456875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.457048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.457152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.457324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.457415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.457594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.457678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.457865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.457946 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.458175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.458263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.458534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.458824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.459085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.459360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.459617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 01:54:37.492544 dv-cinder-799871-46-smb devstack@keystone.service[80077]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac259989c0 pid: 80077 (default app) Jul 28 01:54:37.494000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac259989c0 pid: 80076 (default app) Jul 28 01:54:37.495832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03452a4-c3d4-4865-a097-4eb0bd0b88f7 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:37.496120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03452a4-c3d4-4865-a097-4eb0bd0b88f7 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:37.496389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03452a4-c3d4-4865-a097-4eb0bd0b88f7 None None] PATH_INFO: `/v3` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:37.500683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Thu Jul 28 01:54:37 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:54:45.038310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e8d3-e76c-4443-b5b9-834cc21268ce None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:45.038878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e8d3-e76c-4443-b5b9-834cc21268ce None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:45.038878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e8d3-e76c-4443-b5b9-834cc21268ce None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:45.043908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:54:45.048935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:45.049364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:45.049479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:45.126603 dv-cinder-799871-46-smb devstack@keystone.service[80077]: INFO dbcounter [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] Registered counter for database keystone Jul 28 01:54:45.148306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG oslo_db.sqlalchemy.engines [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:54:45.154925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writer thread running {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:54:45.332063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG passlib.handlers.bcrypt [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80077) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 01:54:45.332484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG passlib.handlers.bcrypt [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80077) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 01:54:45.386510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:45.388067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:45.509160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 28 01:54:45.643666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283e8d3-e76c-4443-b5b9-834cc21268ce None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:45.713260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: INFO dbcounter [None req-b283e8d3-e76c-4443-b5b9-834cc21268ce None None] Registered counter for database keystone Jul 28 01:54:45.731766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG oslo_db.sqlalchemy.engines [None req-b283e8d3-e76c-4443-b5b9-834cc21268ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:54:45.737925 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writer thread running {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:54:45.856087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283e8d3-e76c-4443-b5b9-834cc21268ce None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:45.860586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32dcb2-f846-4dc3-9b32-194f270ee2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:45.861217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32dcb2-f846-4dc3-9b32-194f270ee2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:45.861499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32dcb2-f846-4dc3-9b32-194f270ee2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:45.861774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32dcb2-f846-4dc3-9b32-194f270ee2b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:45.870967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32dcb2-f846-4dc3-9b32-194f270ee2b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:45.923756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8b32dcb2-f846-4dc3-9b32-194f270ee2b4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 01:54:45.924044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32dcb2-f846-4dc3-9b32-194f270ee2b4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:45.934433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Jul 28 01:54:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 01:54:45.940743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:45.955384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e248cba-3819-41b9-affa-dacb59a0f932 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:45.959865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce08f7-52f0-4a7c-9265-258dbd591a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:45.960945 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce08f7-52f0-4a7c-9265-258dbd591a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:45.961222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce08f7-52f0-4a7c-9265-258dbd591a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:45.961498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce08f7-52f0-4a7c-9265-258dbd591a9a admin admin] PATH_INFO: `/v3/projects/610fee5f9cbd481ca2b8410c0ec0c0c0` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:45.963005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce08f7-52f0-4a7c-9265-258dbd591a9a admin admin] RBAC: Authorizing `identity:get_project(project_id=610fee5f9cbd481ca2b8410c0ec0c0c0)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:46.014511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: WARNING keystone.common.rbac_enforcer.enforcer [None req-25ce08f7-52f0-4a7c-9265-258dbd591a9a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 01:54:46.014854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce08f7-52f0-4a7c-9265-258dbd591a9a admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:46.019393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Jul 28 01:54:45 2022] GET /identity/v3/projects/610fee5f9cbd481ca2b8410c0ec0c0c0 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:54:47.990226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62291a6-2ec7-4834-ade3-0646516e22d9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:47.990794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62291a6-2ec7-4834-ade3-0646516e22d9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:47.990794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62291a6-2ec7-4834-ade3-0646516e22d9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:47.994878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:54:48.000145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f27f3e-d9e1-4c98-b2ee-e12e89b573d4 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:48.000563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f27f3e-d9e1-4c98-b2ee-e12e89b573d4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:48.000707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f27f3e-d9e1-4c98-b2ee-e12e89b573d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:48.020466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-20f27f3e-d9e1-4c98-b2ee-e12e89b573d4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:48.021986 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-20f27f3e-d9e1-4c98-b2ee-e12e89b573d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:48.030349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 01:54:48.052203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62291a6-2ec7-4834-ade3-0646516e22d9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:48.064040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62291a6-2ec7-4834-ade3-0646516e22d9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:48.068414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f330d3-eed8-4d44-8131-80c85b927c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:48.069006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f330d3-eed8-4d44-8131-80c85b927c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:48.069284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f330d3-eed8-4d44-8131-80c85b927c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:48.069555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f330d3-eed8-4d44-8131-80c85b927c36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:48.077114 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f330d3-eed8-4d44-8131-80c85b927c36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:48.078921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f330d3-eed8-4d44-8131-80c85b927c36 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:48.087557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Jul 28 01:54:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 01:54:48.093001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f27f3e-d9e1-4c98-b2ee-e12e89b573d4 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:48.101927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f27f3e-d9e1-4c98-b2ee-e12e89b573d4 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:48.106863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989b17b-7c5f-4909-b0d2-389570c9e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:48.107480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989b17b-7c5f-4909-b0d2-389570c9e1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:48.107765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989b17b-7c5f-4909-b0d2-389570c9e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:48.108042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989b17b-7c5f-4909-b0d2-389570c9e1ce admin admin] PATH_INFO: `/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:48.109402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989b17b-7c5f-4909-b0d2-389570c9e1ce admin admin] RBAC: Authorizing `identity:get_user(user_id=e93e6c9ab9a14e7ebbf8568b323f951e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:48.111287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989b17b-7c5f-4909-b0d2-389570c9e1ce admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:48.112833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Jul 28 01:54:48 2022] GET /identity/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:54:50.146042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9c023-3dc3-47f6-80e1-3ed86260ad30 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:50.146539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9c023-3dc3-47f6-80e1-3ed86260ad30 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:50.146539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9c023-3dc3-47f6-80e1-3ed86260ad30 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:50.147859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:54:50.152859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6f98-b40a-421c-8aa6-16e07a9e833d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:50.153246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6f98-b40a-421c-8aa6-16e07a9e833d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:50.153536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6f98-b40a-421c-8aa6-16e07a9e833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:50.172826 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e2ee6f98-b40a-421c-8aa6-16e07a9e833d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:50.174007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e2ee6f98-b40a-421c-8aa6-16e07a9e833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:50.188102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c460d7-7fca-4f28-9cfc-b697ce240996 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:50.188382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c460d7-7fca-4f28-9cfc-b697ce240996 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:50.188653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c460d7-7fca-4f28-9cfc-b697ce240996 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:50.190237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:54:50.194984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3675-221e-4764-b644-b402cce2e8a6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:50.195270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3675-221e-4764-b644-b402cce2e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:50.195548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3675-221e-4764-b644-b402cce2e8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:50.239682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG passlib.handlers.bcrypt [None req-6fcb3675-221e-4764-b644-b402cce2e8a6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80076) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 01:54:50.240117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG passlib.handlers.bcrypt [None req-6fcb3675-221e-4764-b644-b402cce2e8a6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80076) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 01:54:50.253566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:54:50.276147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee6f98-b40a-421c-8aa6-16e07a9e833d None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:50.285722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6fcb3675-221e-4764-b644-b402cce2e8a6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:50.287337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6fcb3675-221e-4764-b644-b402cce2e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:50.299323 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:50.384224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee6f98-b40a-421c-8aa6-16e07a9e833d None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:50.396138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:54:50.418297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2086a65-8240-4db6-9e7f-ee95c2b7d979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:50.418771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3675-221e-4764-b644-b402cce2e8a6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:50.419027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2086a65-8240-4db6-9e7f-ee95c2b7d979 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:50.419313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2086a65-8240-4db6-9e7f-ee95c2b7d979 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:50.419592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2086a65-8240-4db6-9e7f-ee95c2b7d979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:50.430705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2086a65-8240-4db6-9e7f-ee95c2b7d979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-e2086a65-8240-4db6-9e7f-ee95c2b7d979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:54:50.440146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:54:50.441160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:54:50.446839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:54:50.447518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2086a65-8240-4db6-9e7f-ee95c2b7d979 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:50.517826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3675-221e-4764-b644-b402cce2e8a6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:50.520158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:50.526621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:50.547244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2086a65-8240-4db6-9e7f-ee95c2b7d979 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:50.557257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f34b8-f736-4499-b59b-590bdbcfa4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:50.558127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f34b8-f736-4499-b59b-590bdbcfa4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:50.558407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f34b8-f736-4499-b59b-590bdbcfa4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:50.558784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f34b8-f736-4499-b59b-590bdbcfa4f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:50.582080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e19a8a-8c49-41c3-b322-d3a13b67e04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:50.582726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e19a8a-8c49-41c3-b322-d3a13b67e04a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:50.583004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e19a8a-8c49-41c3-b322-d3a13b67e04a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:50.583280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e19a8a-8c49-41c3-b322-d3a13b67e04a None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:50.584007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e19a8a-8c49-41c3-b322-d3a13b67e04a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:54:50.584385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e19a8a-8c49-41c3-b322-d3a13b67e04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:50.585696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e19a8a-8c49-41c3-b322-d3a13b67e04a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:50.597720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:54:50.603217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e19a8a-8c49-41c3-b322-d3a13b67e04a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:50.627069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f34b8-f736-4499-b59b-590bdbcfa4f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:50.628601 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f34b8-f736-4499-b59b-590bdbcfa4f5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:50.731478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:54:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 01:54:50.737303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f34b8-f736-4499-b59b-590bdbcfa4f5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:50.740520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:50.811646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e19a8a-8c49-41c3-b322-d3a13b67e04a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:50.845264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89915a1e-2988-4d9e-9892-0fcf9db76016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:50.845541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f34b8-f736-4499-b59b-590bdbcfa4f5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:50.845895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89915a1e-2988-4d9e-9892-0fcf9db76016 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:50.846175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89915a1e-2988-4d9e-9892-0fcf9db76016 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:50.846468 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89915a1e-2988-4d9e-9892-0fcf9db76016 None admin] PATH_INFO: `/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:50.847645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89915a1e-2988-4d9e-9892-0fcf9db76016 None admin] RBAC: Authorizing `identity:get_user(user_id=e93e6c9ab9a14e7ebbf8568b323f951e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:50.849095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89915a1e-2988-4d9e-9892-0fcf9db76016 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:50.850725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:54:50 2022] GET /identity/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:54:50.856085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89915a1e-2988-4d9e-9892-0fcf9db76016 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:50.872962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:50.884486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfe1c9-934c-4742-a2e1-68f0106ec21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:50.885855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe1c9-934c-4742-a2e1-68f0106ec21f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:50.886129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe1c9-934c-4742-a2e1-68f0106ec21f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:50.886396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe1c9-934c-4742-a2e1-68f0106ec21f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:50.904703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfe1c9-934c-4742-a2e1-68f0106ec21f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:50.906152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfe1c9-934c-4742-a2e1-68f0106ec21f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8bcfe1c9-934c-4742-a2e1-68f0106ec21f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:54:50.923774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:54:50.924603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:54:50.925394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:54:50.925394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:54:50.925394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:54:50.925394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:54:50.925394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:54:50.930936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfe1c9-934c-4742-a2e1-68f0106ec21f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:50.960318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89915a1e-2988-4d9e-9892-0fcf9db76016 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:50.987029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:50.993389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9770667-c5a7-4ae8-8f45-9bceddd7fd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:50.994598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770667-c5a7-4ae8-8f45-9bceddd7fd4e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:50.994875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770667-c5a7-4ae8-8f45-9bceddd7fd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:50.995144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770667-c5a7-4ae8-8f45-9bceddd7fd4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:50.996295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9770667-c5a7-4ae8-8f45-9bceddd7fd4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:50.997737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9770667-c5a7-4ae8-8f45-9bceddd7fd4e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:50.999347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:54:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:54:51.004954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9770667-c5a7-4ae8-8f45-9bceddd7fd4e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:51.031232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfe1c9-934c-4742-a2e1-68f0106ec21f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:51.064296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30b456-0e87-407e-870d-69d54bb4b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:51.065161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30b456-0e87-407e-870d-69d54bb4b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:51.065450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30b456-0e87-407e-870d-69d54bb4b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:51.065729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30b456-0e87-407e-870d-69d54bb4b6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:51.066419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30b456-0e87-407e-870d-69d54bb4b6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:54:51.066752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30b456-0e87-407e-870d-69d54bb4b6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:51.068137 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30b456-0e87-407e-870d-69d54bb4b6e1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:51.084282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:51.085743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:54:51.104685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9770667-c5a7-4ae8-8f45-9bceddd7fd4e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:51.147100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba537d-e9b1-4272-bbe7-b4f1b5092a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:51.147731 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba537d-e9b1-4272-bbe7-b4f1b5092a18 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:51.148013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba537d-e9b1-4272-bbe7-b4f1b5092a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:51.148287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba537d-e9b1-4272-bbe7-b4f1b5092a18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:51.149099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba537d-e9b1-4272-bbe7-b4f1b5092a18 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.domain.id=default, user.id=e93e6c9ab9a14e7ebbf8568b323f951e) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:54:51.149413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba537d-e9b1-4272-bbe7-b4f1b5092a18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:51.150987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba537d-e9b1-4272-bbe7-b4f1b5092a18 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:51.158500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Jul 28 01:54:51 2022] GET /identity/v3/role_assignments?user.id=e93e6c9ab9a14e7ebbf8568b323f951e&scope.domain.id=default&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:54:53.500040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c24fa-fdcd-4a92-9061-916af2391b11 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:53.501054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c24fa-fdcd-4a92-9061-916af2391b11 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:53.501554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c24fa-fdcd-4a92-9061-916af2391b11 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:53.503161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:54:53.508327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8d3f1-a493-4520-8bff-7c174b773441 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:53.509110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8d3f1-a493-4520-8bff-7c174b773441 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:53.510222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8d3f1-a493-4520-8bff-7c174b773441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:53.539416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-48d8d3f1-a493-4520-8bff-7c174b773441 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:53.540986 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-48d8d3f1-a493-4520-8bff-7c174b773441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:53.586475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfae89-93f8-4d33-a4c6-34ad79884ded None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:53.587076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfae89-93f8-4d33-a4c6-34ad79884ded None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:53.587567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfae89-93f8-4d33-a4c6-34ad79884ded None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:53.589612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 12/23] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:54:53.593481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f4537-857e-4c3c-b6b8-62e2ddd2921d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:53.593481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f4537-857e-4c3c-b6b8-62e2ddd2921d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:53.593481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f4537-857e-4c3c-b6b8-62e2ddd2921d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:53.593481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:54:53.599695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edaf8c-925f-4923-8c0f-4e4a2c9fcdeb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:53.600271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edaf8c-925f-4923-8c0f-4e4a2c9fcdeb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:53.600761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edaf8c-925f-4923-8c0f-4e4a2c9fcdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:53.631579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e5edaf8c-925f-4923-8c0f-4e4a2c9fcdeb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:53.632974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e5edaf8c-925f-4923-8c0f-4e4a2c9fcdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:53.640633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 12/25] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:54:53.641808 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a72eb-1cbf-451c-9222-bd3f21397242 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:53.642225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a72eb-1cbf-451c-9222-bd3f21397242 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:53.642532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a72eb-1cbf-451c-9222-bd3f21397242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:53.677775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-3f9a72eb-1cbf-451c-9222-bd3f21397242 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:53.677775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3f9a72eb-1cbf-451c-9222-bd3f21397242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:53.713744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 14/26] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:54:53.716270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edaf8c-925f-4923-8c0f-4e4a2c9fcdeb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:53.817389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 13/27] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:54:53.818277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a72eb-1cbf-451c-9222-bd3f21397242 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:53.821962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:53.830748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:53.896281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edaf8c-925f-4923-8c0f-4e4a2c9fcdeb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:53.939373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3655f6-3357-4f43-bdfd-db9d4f2d6941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:53.942624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3655f6-3357-4f43-bdfd-db9d4f2d6941 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:53.944232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3655f6-3357-4f43-bdfd-db9d4f2d6941 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:53.945327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3655f6-3357-4f43-bdfd-db9d4f2d6941 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:53.947976 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3655f6-3357-4f43-bdfd-db9d4f2d6941 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:53.949569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3655f6-3357-4f43-bdfd-db9d4f2d6941 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:54.065924 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a72eb-1cbf-451c-9222-bd3f21397242 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:54.140107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d9c9f-678a-43c7-abf2-08675d3457c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:54.140686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9c9f-678a-43c7-abf2-08675d3457c6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:54.140962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9c9f-678a-43c7-abf2-08675d3457c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:54.141233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9c9f-678a-43c7-abf2-08675d3457c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:54.161327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d9c9f-678a-43c7-abf2-08675d3457c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-6a5d9c9f-678a-43c7-abf2-08675d3457c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:54:54.166330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:54:54.167187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:54:54.167967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 14/28] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:54:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:54:54.168576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d9c9f-678a-43c7-abf2-08675d3457c6 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:54.245511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:54.284500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d9c9f-678a-43c7-abf2-08675d3457c6 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:54.292907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 15/29] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Jul 28 01:54:53 2022] POST /identity/v3/roles => generated 219 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:54:54.294118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3655f6-3357-4f43-bdfd-db9d4f2d6941 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:54.326467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ad2e1-2623-4ab1-bd7c-497fb8037951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:54.326467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ad2e1-2623-4ab1-bd7c-497fb8037951 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:54.326467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ad2e1-2623-4ab1-bd7c-497fb8037951 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:54.326467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ad2e1-2623-4ab1-bd7c-497fb8037951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:54.336526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ad2e1-2623-4ab1-bd7c-497fb8037951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:54.338099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ad2e1-2623-4ab1-bd7c-497fb8037951 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-af8ad2e1-2623-4ab1-bd7c-497fb8037951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:54:54.356248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:54:54.357289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:54:54.358268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:54:54.358268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:54:54.358268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:54:54.358268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:54:54.358268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 15/30] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:54:54.358788 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95450d-b9c3-40ef-acf8-c931b3b2eb38 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:54.359014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95450d-b9c3-40ef-acf8-c931b3b2eb38 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:54.359289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95450d-b9c3-40ef-acf8-c931b3b2eb38 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:54.362730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 16/31] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:54:54.365022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95450d-b9c3-40ef-acf8-c931b3b2eb38 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:54.488734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3655f6-3357-4f43-bdfd-db9d4f2d6941 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:54.501727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:54.535858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5b0f-ddca-491e-857f-91959487af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:54.536493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5b0f-ddca-491e-857f-91959487af67 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:54.536835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5b0f-ddca-491e-857f-91959487af67 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:54.537115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5b0f-ddca-491e-857f-91959487af67 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:54.537895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa5b0f-ddca-491e-857f-91959487af67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:54:54.538208 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa5b0f-ddca-491e-857f-91959487af67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:54.540352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa5b0f-ddca-491e-857f-91959487af67 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:54.553010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 16/32] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:54:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:54:54.554262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79aad0-18dc-4ec7-aed1-cd60fa531f39 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:54.554490 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79aad0-18dc-4ec7-aed1-cd60fa531f39 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:54.554777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79aad0-18dc-4ec7-aed1-cd60fa531f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:54.557521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95450d-b9c3-40ef-acf8-c931b3b2eb38 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:54.577302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fa79aad0-18dc-4ec7-aed1-cd60fa531f39 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:54.578854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fa79aad0-18dc-4ec7-aed1-cd60fa531f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:54.580304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:54.606626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51d694-9c92-4f8c-a557-c9392141a260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:54.607676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51d694-9c92-4f8c-a557-c9392141a260 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:54.607965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51d694-9c92-4f8c-a557-c9392141a260 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:54.608246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51d694-9c92-4f8c-a557-c9392141a260 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:54.608974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51d694-9c92-4f8c-a557-c9392141a260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:54:54.609285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51d694-9c92-4f8c-a557-c9392141a260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:54.611317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51d694-9c92-4f8c-a557-c9392141a260 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:54.636179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 17/33] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:54:54.637070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51d694-9c92-4f8c-a557-c9392141a260 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:54.669145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 17/34] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:54:54.669795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79aad0-18dc-4ec7-aed1-cd60fa531f39 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:54.769064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51d694-9c92-4f8c-a557-c9392141a260 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:54.797541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:54.801798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79aad0-18dc-4ec7-aed1-cd60fa531f39 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:54.810691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff78e5-6340-4c98-bf02-ccc48212ab99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:54.811342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff78e5-6340-4c98-bf02-ccc48212ab99 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:54.811623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff78e5-6340-4c98-bf02-ccc48212ab99 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:54.812126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff78e5-6340-4c98-bf02-ccc48212ab99 None admin] PATH_INFO: `/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:54.813083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff78e5-6340-4c98-bf02-ccc48212ab99 None admin] RBAC: Authorizing `identity:get_user(user_id=e93e6c9ab9a14e7ebbf8568b323f951e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:54.814587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff78e5-6340-4c98-bf02-ccc48212ab99 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:54.816475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 18/35] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:54:54 2022] GET /identity/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:54:54.817211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff78e5-6340-4c98-bf02-ccc48212ab99 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:54.843091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae142b30-15b1-4d85-88f5-062b23893b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:54.844721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae142b30-15b1-4d85-88f5-062b23893b1b None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:54.845207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae142b30-15b1-4d85-88f5-062b23893b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:54.845932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae142b30-15b1-4d85-88f5-062b23893b1b None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:54.847764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae142b30-15b1-4d85-88f5-062b23893b1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:54.850105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae142b30-15b1-4d85-88f5-062b23893b1b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:54.869119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:54.883747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 18/36] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:54:54 2022] POST /identity/v3/projects => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:54:54.885030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ff35f-8caa-4e37-bb4d-b02f29771dc1 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:54.885322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ff35f-8caa-4e37-bb4d-b02f29771dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:54.885656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ff35f-8caa-4e37-bb4d-b02f29771dc1 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:54.890607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 19/37] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:54:54.890607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ff35f-8caa-4e37-bb4d-b02f29771dc1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:54.953836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff78e5-6340-4c98-bf02-ccc48212ab99 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:54.995739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e53778-8444-4b12-bd8f-bfe5dbf9f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:54.996369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53778-8444-4b12-bd8f-bfe5dbf9f86c None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:54.996650 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53778-8444-4b12-bd8f-bfe5dbf9f86c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:54.996919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53778-8444-4b12-bd8f-bfe5dbf9f86c None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:54.997820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e53778-8444-4b12-bd8f-bfe5dbf9f86c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:54.999272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e53778-8444-4b12-bd8f-bfe5dbf9f86c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:55.032266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ff35f-8caa-4e37-bb4d-b02f29771dc1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:55.075420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc97f55-bb14-40dc-a286-1840afba1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:55.076406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97f55-bb14-40dc-a286-1840afba1d6f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:55.076755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97f55-bb14-40dc-a286-1840afba1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:55.077083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97f55-bb14-40dc-a286-1840afba1d6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:55.078270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc97f55-bb14-40dc-a286-1840afba1d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:55.079739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc97f55-bb14-40dc-a286-1840afba1d6f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:55.081536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:54:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:54:55.082489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce078-0e63-4b5b-98c2-a7e94cfff36c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:55.082774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce078-0e63-4b5b-98c2-a7e94cfff36c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:55.083045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce078-0e63-4b5b-98c2-a7e94cfff36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:55.102206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9ccce078-0e63-4b5b-98c2-a7e94cfff36c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:55.103438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9ccce078-0e63-4b5b-98c2-a7e94cfff36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:55.116309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:55.123014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Jul 28 01:54:54 2022] POST /identity/v3/roles => generated 225 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:54:55.124498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dd36e-0d18-4e78-85e9-5bf8b0e86199 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:55.124797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dd36e-0d18-4e78-85e9-5bf8b0e86199 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:55.125309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dd36e-0d18-4e78-85e9-5bf8b0e86199 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:55.126562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 20/40] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:54:55.127073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dd36e-0d18-4e78-85e9-5bf8b0e86199 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:55.184868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 21/41] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:54:55.186078 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242759f-443e-4a26-b081-9321ac783641 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:55.186368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242759f-443e-4a26-b081-9321ac783641 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:55.186672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242759f-443e-4a26-b081-9321ac783641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:55.206944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0242759f-443e-4a26-b081-9321ac783641 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:55.208380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0242759f-443e-4a26-b081-9321ac783641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:55.266396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dd36e-0d18-4e78-85e9-5bf8b0e86199 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:55.269801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:55.286065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 22/42] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:54:55.287415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242759f-443e-4a26-b081-9321ac783641 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:55.318091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26652a2d-2340-469b-b2e7-19220a78c328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:55.318908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652a2d-2340-469b-b2e7-19220a78c328 None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:55.319187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652a2d-2340-469b-b2e7-19220a78c328 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:55.319463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652a2d-2340-469b-b2e7-19220a78c328 None admin] PATH_INFO: `/v3/domains/default/users/e93e6c9ab9a14e7ebbf8568b323f951e/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:55.321642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26652a2d-2340-469b-b2e7-19220a78c328 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e93e6c9ab9a14e7ebbf8568b323f951e, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:55.323833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26652a2d-2340-469b-b2e7-19220a78c328 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:55.341858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 21/43] 10.222.0.36 () {58 vars in 1361 bytes} [Thu Jul 28 01:54:55 2022] PUT /identity/v3/domains/default/users/e93e6c9ab9a14e7ebbf8568b323f951e/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:54:55.342687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26652a2d-2340-469b-b2e7-19220a78c328 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:55.390120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:55.416216 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242759f-443e-4a26-b081-9321ac783641 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:55.456821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034bf07-4f4b-4616-9f48-1917499b9206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:55.457893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034bf07-4f4b-4616-9f48-1917499b9206 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:55.458288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034bf07-4f4b-4616-9f48-1917499b9206 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:55.458608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034bf07-4f4b-4616-9f48-1917499b9206 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:55.459843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034bf07-4f4b-4616-9f48-1917499b9206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:55.460180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26652a2d-2340-469b-b2e7-19220a78c328 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:55.461326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034bf07-4f4b-4616-9f48-1917499b9206 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:55.463534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 23/44] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:54:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:54:55.468779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034bf07-4f4b-4616-9f48-1917499b9206 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:55.508004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ca327-3bbc-443c-900a-1adffbdba80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:55.508629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ca327-3bbc-443c-900a-1adffbdba80c None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:55.509233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ca327-3bbc-443c-900a-1adffbdba80c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:55.509233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ca327-3bbc-443c-900a-1adffbdba80c None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:55.510508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ca327-3bbc-443c-900a-1adffbdba80c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:55.511918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ca327-3bbc-443c-900a-1adffbdba80c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:55.534468 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Jul 28 01:54:55 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:54:55.586838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034bf07-4f4b-4616-9f48-1917499b9206 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:55.624966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3818-34eb-4696-ae5d-e42d4092b97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:55.625603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3818-34eb-4696-ae5d-e42d4092b97e None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:55.625888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3818-34eb-4696-ae5d-e42d4092b97e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:55.626168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3818-34eb-4696-ae5d-e42d4092b97e None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:55.626904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3818-34eb-4696-ae5d-e42d4092b97e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:55.628435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3818-34eb-4696-ae5d-e42d4092b97e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:55.654646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:55.666643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:54:55 2022] POST /identity/v3/projects => generated 312 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 01:54:57.340249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8612f5f-23cd-4805-9694-d8c758c13e21 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:57.340780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8612f5f-23cd-4805-9694-d8c758c13e21 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:57.340780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8612f5f-23cd-4805-9694-d8c758c13e21 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:57.342148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 23/47] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:54:57.347442 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dfe3e-d24f-4b15-8e21-4b3f49e9f5e4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:57.347884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dfe3e-d24f-4b15-8e21-4b3f49e9f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:57.348007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dfe3e-d24f-4b15-8e21-4b3f49e9f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:57.366382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e78dfe3e-d24f-4b15-8e21-4b3f49e9f5e4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:57.367606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e78dfe3e-d24f-4b15-8e21-4b3f49e9f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:57.433517 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 25/48] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:54:57.455920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8612f5f-23cd-4805-9694-d8c758c13e21 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:57.481135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:57.558587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8612f5f-23cd-4805-9694-d8c758c13e21 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:57.591407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d717-9fdd-4909-8ea3-d60af8993fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:57.591973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d717-9fdd-4909-8ea3-d60af8993fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:57.592261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d717-9fdd-4909-8ea3-d60af8993fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:57.592539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d717-9fdd-4909-8ea3-d60af8993fb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:57.602585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6d717-9fdd-4909-8ea3-d60af8993fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-0cf6d717-9fdd-4909-8ea3-d60af8993fb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:54:57.608527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:54:57.609345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:54:57.610154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:54:57.614370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 24/49] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:54:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:54:57.615536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dfe3e-d24f-4b15-8e21-4b3f49e9f5e4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:57.667167 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c946-bec6-470a-92f6-28d9daa30aec None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:57.667461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c946-bec6-470a-92f6-28d9daa30aec None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:57.667745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c946-bec6-470a-92f6-28d9daa30aec None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:57.669107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 25/50] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:54:57.673941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab88da1-7d39-41e0-9008-5c98223e5037 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:57.674228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab88da1-7d39-41e0-9008-5c98223e5037 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:57.674532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab88da1-7d39-41e0-9008-5c98223e5037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:57.693183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-cab88da1-7d39-41e0-9008-5c98223e5037 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:54:57.694723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-cab88da1-7d39-41e0-9008-5c98223e5037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:54:57.715221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dfe3e-d24f-4b15-8e21-4b3f49e9f5e4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:57.742236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:57.750192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f654b3-4412-4a8d-a596-58a73552b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:57.750846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f654b3-4412-4a8d-a596-58a73552b000 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:57.751132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f654b3-4412-4a8d-a596-58a73552b000 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:57.751418 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f654b3-4412-4a8d-a596-58a73552b000 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:57.752138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f654b3-4412-4a8d-a596-58a73552b000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:54:57.752449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f654b3-4412-4a8d-a596-58a73552b000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:57.753822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f654b3-4412-4a8d-a596-58a73552b000 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:57.761495 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 26/51] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:54:57.761768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 26/52] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:54:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:54:57.767865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab88da1-7d39-41e0-9008-5c98223e5037 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:57.783259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:57.784214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f654b3-4412-4a8d-a596-58a73552b000 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:57.867360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab88da1-7d39-41e0-9008-5c98223e5037 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:57.885101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f654b3-4412-4a8d-a596-58a73552b000 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:57.902310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec89190-c97e-4537-a146-401d151491a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:57.902989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec89190-c97e-4537-a146-401d151491a7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:57.903274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec89190-c97e-4537-a146-401d151491a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:57.903551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec89190-c97e-4537-a146-401d151491a7 None admin] PATH_INFO: `/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:57.904741 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec89190-c97e-4537-a146-401d151491a7 None admin] RBAC: Authorizing `identity:get_user(user_id=e93e6c9ab9a14e7ebbf8568b323f951e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:57.906221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec89190-c97e-4537-a146-401d151491a7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:57.907875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:54:57 2022] GET /identity/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:54:57.913304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec89190-c97e-4537-a146-401d151491a7 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:57.919875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5173b-7d4b-404e-86fe-a7d6d08eb2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:57.920515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5173b-7d4b-404e-86fe-a7d6d08eb2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:57.920793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5173b-7d4b-404e-86fe-a7d6d08eb2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:57.921066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5173b-7d4b-404e-86fe-a7d6d08eb2b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:57.922225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5173b-7d4b-404e-86fe-a7d6d08eb2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:57.923687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5173b-7d4b-404e-86fe-a7d6d08eb2b4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:57.925270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 27/54] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:54:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:54:57.930739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5173b-7d4b-404e-86fe-a7d6d08eb2b4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:57.987559 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:57.993006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:54:58.011554 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec89190-c97e-4537-a146-401d151491a7 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:58.030611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5173b-7d4b-404e-86fe-a7d6d08eb2b4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:58.044761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d135-e2ab-4687-a2b6-6c39918ce09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:58.045393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d135-e2ab-4687-a2b6-6c39918ce09c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:58.045675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d135-e2ab-4687-a2b6-6c39918ce09c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:58.045948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d135-e2ab-4687-a2b6-6c39918ce09c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:58.047135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559d135-e2ab-4687-a2b6-6c39918ce09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:58.048604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559d135-e2ab-4687-a2b6-6c39918ce09c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:58.050206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:54:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:54:58.055952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d135-e2ab-4687-a2b6-6c39918ce09c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:54:58.063581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f52e9-c370-4956-a4cc-213abd7fb571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:58.064243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f52e9-c370-4956-a4cc-213abd7fb571 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:58.064529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f52e9-c370-4956-a4cc-213abd7fb571 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:58.065063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f52e9-c370-4956-a4cc-213abd7fb571 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:58.065742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f52e9-c370-4956-a4cc-213abd7fb571 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:58.067200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f52e9-c370-4956-a4cc-213abd7fb571 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:58.094953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 28/56] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Jul 28 01:54:57 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 01:54:58.159345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d135-e2ab-4687-a2b6-6c39918ce09c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:54:58.194791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcca37-e86f-4dc1-a9fa-a11a11664a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:54:58.195423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcca37-e86f-4dc1-a9fa-a11a11664a6e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:54:58.195707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcca37-e86f-4dc1-a9fa-a11a11664a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:54:58.195982 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcca37-e86f-4dc1-a9fa-a11a11664a6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:54:58.196795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcca37-e86f-4dc1-a9fa-a11a11664a6e None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.domain.id=default, user.id=e93e6c9ab9a14e7ebbf8568b323f951e) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:54:58.197644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcca37-e86f-4dc1-a9fa-a11a11664a6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:54:58.199217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcca37-e86f-4dc1-a9fa-a11a11664a6e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:54:58.205752 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Jul 28 01:54:58 2022] GET /identity/v3/role_assignments?user.id=e93e6c9ab9a14e7ebbf8568b323f951e&scope.domain.id=default&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:00.082856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4cd71-a6ae-4d84-b718-445ac943023b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:00.083374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4cd71-a6ae-4d84-b718-445ac943023b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:00.083454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4cd71-a6ae-4d84-b718-445ac943023b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:00.084791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 29/58] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:00.090405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28e04d-e741-4e87-bbb6-e088e911230d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:00.090837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28e04d-e741-4e87-bbb6-e088e911230d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:00.090989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28e04d-e741-4e87-bbb6-e088e911230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:00.108936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4e28e04d-e741-4e87-bbb6-e088e911230d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:00.110119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4e28e04d-e741-4e87-bbb6-e088e911230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:00.118978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:00.174763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 30/59] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:00.198368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4cd71-a6ae-4d84-b718-445ac943023b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:00.295560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4cd71-a6ae-4d84-b718-445ac943023b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:00.305636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:00.329245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4553c-2036-48b4-9e80-1c16b6cd444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:00.329864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4553c-2036-48b4-9e80-1c16b6cd444a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:00.330139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4553c-2036-48b4-9e80-1c16b6cd444a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:00.330406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4553c-2036-48b4-9e80-1c16b6cd444a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:00.331567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4553c-2036-48b4-9e80-1c16b6cd444a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:00.332996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4553c-2036-48b4-9e80-1c16b6cd444a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:00.334559 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 30/60] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:00.340470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28e04d-e741-4e87-bbb6-e088e911230d None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:00.435211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28e04d-e741-4e87-bbb6-e088e911230d None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:00.468530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9b9a-1ca3-40b3-99b9-09d5c619e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:00.469132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9b9a-1ca3-40b3-99b9-09d5c619e5c3 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:00.469413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9b9a-1ca3-40b3-99b9-09d5c619e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:00.469688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9b9a-1ca3-40b3-99b9-09d5c619e5c3 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:00.470375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9b9a-1ca3-40b3-99b9-09d5c619e5c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:00.471853 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9b9a-1ca3-40b3-99b9-09d5c619e5c3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:00.493552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:00.498483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 31/61] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:00 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:03.477936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ddb4e-4781-4db4-8ccb-e738bccfe09f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:03.479020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ddb4e-4781-4db4-8ccb-e738bccfe09f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:03.479020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ddb4e-4781-4db4-8ccb-e738bccfe09f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:03.480420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 31/62] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:03.485743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52959f-eb85-426d-a8f4-8bafb630548e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:03.486139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52959f-eb85-426d-a8f4-8bafb630548e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:03.486323 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52959f-eb85-426d-a8f4-8bafb630548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:03.510516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-cd52959f-eb85-426d-a8f4-8bafb630548e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:03.511738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-cd52959f-eb85-426d-a8f4-8bafb630548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:03.596463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 32/63] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:03.631742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ddb4e-4781-4db4-8ccb-e738bccfe09f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:03.772116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ddb4e-4781-4db4-8ccb-e738bccfe09f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:03.776358 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be2d6-a916-4ade-8170-3e7a2861c467 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:03.776917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be2d6-a916-4ade-8170-3e7a2861c467 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:03.777397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be2d6-a916-4ade-8170-3e7a2861c467 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:03.779012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 33/64] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:03.784503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08abee-13f3-445a-8bca-5c66f7f58f85 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:03.784783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08abee-13f3-445a-8bca-5c66f7f58f85 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:03.785273 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08abee-13f3-445a-8bca-5c66f7f58f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:03.811403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-6e08abee-13f3-445a-8bca-5c66f7f58f85 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:03.814120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6e08abee-13f3-445a-8bca-5c66f7f58f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:03.827375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d640668-863e-41a3-a484-44c5878c99f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:03.828022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d640668-863e-41a3-a484-44c5878c99f0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:03.828300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d640668-863e-41a3-a484-44c5878c99f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:03.828567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d640668-863e-41a3-a484-44c5878c99f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:03.840641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d640668-863e-41a3-a484-44c5878c99f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0d640668-863e-41a3-a484-44c5878c99f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:03.847786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:03.848620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:03.849374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:03.852185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 32/65] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:03.854098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074b7e-6e93-4e82-b240-550310e8598a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:03.854682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074b7e-6e93-4e82-b240-550310e8598a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:03.855147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074b7e-6e93-4e82-b240-550310e8598a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:03.856601 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 33/66] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:03.862147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be4a57-4a14-4820-9294-a042a3dd7393 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:03.862750 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be4a57-4a14-4820-9294-a042a3dd7393 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:03.863219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be4a57-4a14-4820-9294-a042a3dd7393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:03.887033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-94be4a57-4a14-4820-9294-a042a3dd7393 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:03.888937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-94be4a57-4a14-4820-9294-a042a3dd7393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:03.902958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 34/67] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:03.903931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08abee-13f3-445a-8bca-5c66f7f58f85 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:03.926130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:03.974980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:03.976930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 34/68] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:03.977861 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be4a57-4a14-4820-9294-a042a3dd7393 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.020670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08abee-13f3-445a-8bca-5c66f7f58f85 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:04.058750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bc648-7ea3-4a34-9c21-74c631cab20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:04.059702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bc648-7ea3-4a34-9c21-74c631cab20c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.060194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bc648-7ea3-4a34-9c21-74c631cab20c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.060662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bc648-7ea3-4a34-9c21-74c631cab20c None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.061608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bc648-7ea3-4a34-9c21-74c631cab20c None admin] RBAC: Adding query filter params (name=member) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:04.062107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bc648-7ea3-4a34-9c21-74c631cab20c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:04.063917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bc648-7ea3-4a34-9c21-74c631cab20c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:04.073995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:04.075096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bc648-7ea3-4a34-9c21-74c631cab20c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.101827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be4a57-4a14-4820-9294-a042a3dd7393 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:04.139386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d492f-357b-4448-88e7-89853851f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:04.140040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d492f-357b-4448-88e7-89853851f35e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.140321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d492f-357b-4448-88e7-89853851f35e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.140592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d492f-357b-4448-88e7-89853851f35e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.151469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d492f-357b-4448-88e7-89853851f35e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-410d492f-357b-4448-88e7-89853851f35e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:04.157071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:04.157912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:04.158692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 35/70] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:55:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:04.159918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d492f-357b-4448-88e7-89853851f35e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.191861 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:04.193802 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bc648-7ea3-4a34-9c21-74c631cab20c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:04.218226 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:04.230921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ad616-8404-4316-85ba-1ae412ca0345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:04.231568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ad616-8404-4316-85ba-1ae412ca0345 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.231851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ad616-8404-4316-85ba-1ae412ca0345 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.232122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ad616-8404-4316-85ba-1ae412ca0345 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.242486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ad616-8404-4316-85ba-1ae412ca0345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-2b5ad616-8404-4316-85ba-1ae412ca0345 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:04.247881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:04.248728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:04.249466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:04.250731 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24aa9e-2966-4813-be5c-a00ad6a91ecf None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.250828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24aa9e-2966-4813-be5c-a00ad6a91ecf None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.251090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24aa9e-2966-4813-be5c-a00ad6a91ecf None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.254563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 37/72] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:04.254563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24aa9e-2966-4813-be5c-a00ad6a91ecf None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.277084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d492f-357b-4448-88e7-89853851f35e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:04.314309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0789f2-d507-4551-8dc1-6c1eac97becf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:04.315596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0789f2-d507-4551-8dc1-6c1eac97becf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.315881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0789f2-d507-4551-8dc1-6c1eac97becf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.316152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0789f2-d507-4551-8dc1-6c1eac97becf None admin] PATH_INFO: `/v3/users/1921ee40ca9a4f31b2382206170afd2f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.339970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0789f2-d507-4551-8dc1-6c1eac97becf None admin] RBAC: Authorizing `identity:get_user(user_id=1921ee40ca9a4f31b2382206170afd2f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:04.341447 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0789f2-d507-4551-8dc1-6c1eac97becf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:04.345719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:04 2022] GET /identity/v3/users/1921ee40ca9a4f31b2382206170afd2f => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:04.346609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0789f2-d507-4551-8dc1-6c1eac97becf None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.363201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24aa9e-2966-4813-be5c-a00ad6a91ecf None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:04.396676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121daba-10ad-466b-92e4-348ba170b2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:04.397288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121daba-10ad-466b-92e4-348ba170b2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.397572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121daba-10ad-466b-92e4-348ba170b2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.397847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121daba-10ad-466b-92e4-348ba170b2a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.399022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121daba-10ad-466b-92e4-348ba170b2a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:04.399333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121daba-10ad-466b-92e4-348ba170b2a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:04.401314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121daba-10ad-466b-92e4-348ba170b2a1 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:04.409546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 38/74] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:04.410715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d5d79-6a8f-429e-813d-b26c271fe946 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.411023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d5d79-6a8f-429e-813d-b26c271fe946 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.411271 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d5d79-6a8f-429e-813d-b26c271fe946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.427947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-0f3d5d79-6a8f-429e-813d-b26c271fe946 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:04.429136 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0f3d5d79-6a8f-429e-813d-b26c271fe946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:04.434183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:04.450875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0789f2-d507-4551-8dc1-6c1eac97becf None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:04.469697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:04.483965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c017be-32e5-403c-bbb9-66f84e734be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:04.484586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c017be-32e5-403c-bbb9-66f84e734be3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.484868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c017be-32e5-403c-bbb9-66f84e734be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.485140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c017be-32e5-403c-bbb9-66f84e734be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.485846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c017be-32e5-403c-bbb9-66f84e734be3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:04.486150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c017be-32e5-403c-bbb9-66f84e734be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:04.487550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c017be-32e5-403c-bbb9-66f84e734be3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:04.495968 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:04.507040 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 39/76] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:04.507512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92499-e049-4f40-beb5-7646659d505f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.507512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92499-e049-4f40-beb5-7646659d505f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.507512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb92499-e049-4f40-beb5-7646659d505f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.507687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d5d79-6a8f-429e-813d-b26c271fe946 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.507771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 38/77] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:04.507771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb92499-e049-4f40-beb5-7646659d505f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.603110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d5d79-6a8f-429e-813d-b26c271fe946 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:04.603294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb92499-e049-4f40-beb5-7646659d505f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:04.636817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022a3c-a491-4561-bfa3-be48e11e3f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:04.636997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c2718-be17-4d01-87b0-7e0dbf84871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:04.637429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c2718-be17-4d01-87b0-7e0dbf84871b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.637516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022a3c-a491-4561-bfa3-be48e11e3f22 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.637707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022a3c-a491-4561-bfa3-be48e11e3f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.637788 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c2718-be17-4d01-87b0-7e0dbf84871b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.637978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022a3c-a491-4561-bfa3-be48e11e3f22 None admin] PATH_INFO: `/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.638062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c2718-be17-4d01-87b0-7e0dbf84871b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.639156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41022a3c-a491-4561-bfa3-be48e11e3f22 None admin] RBAC: Authorizing `identity:get_user(user_id=e93e6c9ab9a14e7ebbf8568b323f951e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:04.640597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41022a3c-a491-4561-bfa3-be48e11e3f22 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:04.642183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 39/78] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:04 2022] GET /identity/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:04.643047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022a3c-a491-4561-bfa3-be48e11e3f22 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.660254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:04.683388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:04.708981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c2718-be17-4d01-87b0-7e0dbf84871b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:04.710485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c2718-be17-4d01-87b0-7e0dbf84871b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:04.744850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022a3c-a491-4561-bfa3-be48e11e3f22 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:04.778745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c34fb-3c67-4774-8b51-0d74e92a50bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:04.778745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c34fb-3c67-4774-8b51-0d74e92a50bd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.779057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c34fb-3c67-4774-8b51-0d74e92a50bd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.779303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c34fb-3c67-4774-8b51-0d74e92a50bd None admin] PATH_INFO: `/v3/users/1921ee40ca9a4f31b2382206170afd2f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.780470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c34fb-3c67-4774-8b51-0d74e92a50bd None admin] RBAC: Authorizing `identity:get_user(user_id=1921ee40ca9a4f31b2382206170afd2f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:04.781912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c34fb-3c67-4774-8b51-0d74e92a50bd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:04.783705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 40/79] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:04 2022] GET /identity/v3/users/1921ee40ca9a4f31b2382206170afd2f => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:04.784639 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5ce2-b6de-4f4d-b0c1-2e480331b921 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.784934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5ce2-b6de-4f4d-b0c1-2e480331b921 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.785209 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5ce2-b6de-4f4d-b0c1-2e480331b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.802045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ccda5ce2-b6de-4f4d-b0c1-2e480331b921 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:04.803251 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ccda5ce2-b6de-4f4d-b0c1-2e480331b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:04.809110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 40/80] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:04.809941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c2718-be17-4d01-87b0-7e0dbf84871b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.871704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 41/81] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:04.872875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5ce2-b6de-4f4d-b0c1-2e480331b921 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.884300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:04.898212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:04.909225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c2718-be17-4d01-87b0-7e0dbf84871b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:04.945295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710a242-3979-4a86-9943-a6ce66b136bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:04.945927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710a242-3979-4a86-9943-a6ce66b136bf None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:04.946203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710a242-3979-4a86-9943-a6ce66b136bf None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:04.946494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710a242-3979-4a86-9943-a6ce66b136bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:04.957577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710a242-3979-4a86-9943-a6ce66b136bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-c710a242-3979-4a86-9943-a6ce66b136bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:04.962672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:04.963492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:04.964270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 41/82] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:04.964885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710a242-3979-4a86-9943-a6ce66b136bf None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:04.987097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5ce2-b6de-4f4d-b0c1-2e480331b921 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.020697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979596e-2dbb-4152-b782-651a2e1e74fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:05.021316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979596e-2dbb-4152-b782-651a2e1e74fc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:05.021595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979596e-2dbb-4152-b782-651a2e1e74fc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:05.021871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979596e-2dbb-4152-b782-651a2e1e74fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:05.063581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710a242-3979-4a86-9943-a6ce66b136bf None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.088079 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979596e-2dbb-4152-b782-651a2e1e74fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:05.089533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979596e-2dbb-4152-b782-651a2e1e74fc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:05.095204 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb2d4e-ef5e-4482-a8af-aeea94d90edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:05.095825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb2d4e-ef5e-4482-a8af-aeea94d90edb None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:05.096104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb2d4e-ef5e-4482-a8af-aeea94d90edb None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:05.096377 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb2d4e-ef5e-4482-a8af-aeea94d90edb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:05.098996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:05.104752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:05.164251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb2d4e-ef5e-4482-a8af-aeea94d90edb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:05.166185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb2d4e-ef5e-4482-a8af-aeea94d90edb None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:05.189084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 42/83] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:05.189734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979596e-2dbb-4152-b782-651a2e1e74fc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:05.267915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 42/84] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:05.268767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb2d4e-ef5e-4482-a8af-aeea94d90edb None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:05.294074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979596e-2dbb-4152-b782-651a2e1e74fc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.302265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:05.309379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:05.329840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1184eb-4060-4e54-b36e-88ab645d35ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:05.330506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1184eb-4060-4e54-b36e-88ab645d35ee None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:05.330784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1184eb-4060-4e54-b36e-88ab645d35ee None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:05.331060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1184eb-4060-4e54-b36e-88ab645d35ee None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:05.332206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1184eb-4060-4e54-b36e-88ab645d35ee None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:05.333644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1184eb-4060-4e54-b36e-88ab645d35ee None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:05.335340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 43/85] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:05 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:05.336091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1184eb-4060-4e54-b36e-88ab645d35ee None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:05.370649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb2d4e-ef5e-4482-a8af-aeea94d90edb None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.404245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fe346-6da6-4ae1-b6ed-95c987a22b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:05.404875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe346-6da6-4ae1-b6ed-95c987a22b5c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:05.405152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe346-6da6-4ae1-b6ed-95c987a22b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:05.405425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe346-6da6-4ae1-b6ed-95c987a22b5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:05.406597 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fe346-6da6-4ae1-b6ed-95c987a22b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:05.408056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fe346-6da6-4ae1-b6ed-95c987a22b5c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:05.409639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 43/86] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:05.410398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fe346-6da6-4ae1-b6ed-95c987a22b5c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:05.439700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1184eb-4060-4e54-b36e-88ab645d35ee None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.473476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eef917-d884-407c-b705-dfbdf547597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:05.474102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef917-d884-407c-b705-dfbdf547597b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:05.474384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef917-d884-407c-b705-dfbdf547597b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:05.474693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eef917-d884-407c-b705-dfbdf547597b None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:05.475416 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eef917-d884-407c-b705-dfbdf547597b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:05.475722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eef917-d884-407c-b705-dfbdf547597b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:05.477113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eef917-d884-407c-b705-dfbdf547597b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:05.485416 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 44/87] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:05.486202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eef917-d884-407c-b705-dfbdf547597b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:05.508459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fe346-6da6-4ae1-b6ed-95c987a22b5c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.509985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:05.531564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:05.545004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a498-c67b-4c56-b12d-9dd8e119193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:05.545635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a498-c67b-4c56-b12d-9dd8e119193f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:05.545913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a498-c67b-4c56-b12d-9dd8e119193f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:05.546185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a498-c67b-4c56-b12d-9dd8e119193f None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:05.547374 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a498-c67b-4c56-b12d-9dd8e119193f None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:05.548822 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a498-c67b-4c56-b12d-9dd8e119193f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:05.550492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 44/88] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:05 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:05.551252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a498-c67b-4c56-b12d-9dd8e119193f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:05.591245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eef917-d884-407c-b705-dfbdf547597b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.623597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627e67-1e97-499b-b497-c45205206a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:05.624230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627e67-1e97-499b-b497-c45205206a44 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:05.624513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627e67-1e97-499b-b497-c45205206a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:05.624792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627e67-1e97-499b-b497-c45205206a44 None admin] PATH_INFO: `/v3/projects/90ada0c2e2734f92bd3009ddbd717759` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:05.625945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627e67-1e97-499b-b497-c45205206a44 None admin] RBAC: Authorizing `identity:get_project(project_id=90ada0c2e2734f92bd3009ddbd717759)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:05.627470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627e67-1e97-499b-b497-c45205206a44 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:05.629132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 45/89] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:05 2022] GET /identity/v3/projects/90ada0c2e2734f92bd3009ddbd717759 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:05.629870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627e67-1e97-499b-b497-c45205206a44 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:05.651623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a498-c67b-4c56-b12d-9dd8e119193f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.684035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc24cff-2a2d-44a9-bf96-599cca16bc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:05.684644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc24cff-2a2d-44a9-bf96-599cca16bc42 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:05.684922 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc24cff-2a2d-44a9-bf96-599cca16bc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:05.685204 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc24cff-2a2d-44a9-bf96-599cca16bc42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:05.685990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc24cff-2a2d-44a9-bf96-599cca16bc42 None admin] RBAC: Adding query filter params (role.id=55fc2032ca914d2fb1ec5cbd52f60e54, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5, user.id=1921ee40ca9a4f31b2382206170afd2f) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:05.686299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc24cff-2a2d-44a9-bf96-599cca16bc42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:05.687793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc24cff-2a2d-44a9-bf96-599cca16bc42 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:05.693795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 45/90] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:05 2022] GET /identity/v3/role_assignments?user.id=1921ee40ca9a4f31b2382206170afd2f&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:05.694541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc24cff-2a2d-44a9-bf96-599cca16bc42 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:05.738804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627e67-1e97-499b-b497-c45205206a44 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.748041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:05.753739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:05.777388 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6551d-ab59-45f9-9215-95bf7e6cd2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:05.778030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6551d-ab59-45f9-9215-95bf7e6cd2b0 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:05.778317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6551d-ab59-45f9-9215-95bf7e6cd2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:05.778621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6551d-ab59-45f9-9215-95bf7e6cd2b0 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:05.779325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6551d-ab59-45f9-9215-95bf7e6cd2b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:05.780809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6551d-ab59-45f9-9215-95bf7e6cd2b0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:05.809942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 46/91] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:05 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:05.811200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6551d-ab59-45f9-9215-95bf7e6cd2b0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:05.839621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc24cff-2a2d-44a9-bf96-599cca16bc42 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.891244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21865b-1156-46b4-8c29-5dc8b17fcb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:05.892194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21865b-1156-46b4-8c29-5dc8b17fcb7c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:05.892748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21865b-1156-46b4-8c29-5dc8b17fcb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:05.893130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21865b-1156-46b4-8c29-5dc8b17fcb7c None admin] PATH_INFO: `/v3/users/1921ee40ca9a4f31b2382206170afd2f` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:05.895024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21865b-1156-46b4-8c29-5dc8b17fcb7c None admin] RBAC: Authorizing `identity:get_user(user_id=1921ee40ca9a4f31b2382206170afd2f)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:05.897448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21865b-1156-46b4-8c29-5dc8b17fcb7c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:05.900215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 46/92] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:05 2022] GET /identity/v3/users/1921ee40ca9a4f31b2382206170afd2f => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:05.901635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21865b-1156-46b4-8c29-5dc8b17fcb7c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:05.954458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6551d-ab59-45f9-9215-95bf7e6cd2b0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:05.999068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589575c-51fd-4818-8f68-74de2cd43c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:06.000487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589575c-51fd-4818-8f68-74de2cd43c24 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:06.000959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589575c-51fd-4818-8f68-74de2cd43c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:06.002612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589575c-51fd-4818-8f68-74de2cd43c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:06.004124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589575c-51fd-4818-8f68-74de2cd43c24 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5, user.id=e93e6c9ab9a14e7ebbf8568b323f951e) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:06.004124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589575c-51fd-4818-8f68-74de2cd43c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:06.006689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589575c-51fd-4818-8f68-74de2cd43c24 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:06.018799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 47/93] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:05 2022] GET /identity/v3/role_assignments?user.id=e93e6c9ab9a14e7ebbf8568b323f951e&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:06.019923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589575c-51fd-4818-8f68-74de2cd43c24 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:06.033148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21865b-1156-46b4-8c29-5dc8b17fcb7c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:06.050899 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:06.065124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:06.091089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd06c70-15f3-4e1f-b1aa-98439a37c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:06.091755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd06c70-15f3-4e1f-b1aa-98439a37c3af None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:06.092036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd06c70-15f3-4e1f-b1aa-98439a37c3af None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:06.092309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd06c70-15f3-4e1f-b1aa-98439a37c3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:06.093214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd06c70-15f3-4e1f-b1aa-98439a37c3af None admin] RBAC: Adding query filter params (role.id=55fc2032ca914d2fb1ec5cbd52f60e54, scope.project.id=90ada0c2e2734f92bd3009ddbd717759, user.id=1921ee40ca9a4f31b2382206170afd2f) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:06.093528 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd06c70-15f3-4e1f-b1aa-98439a37c3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:06.095258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd06c70-15f3-4e1f-b1aa-98439a37c3af None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:06.103844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 47/94] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:05 2022] GET /identity/v3/role_assignments?user.id=1921ee40ca9a4f31b2382206170afd2f&scope.project.id=90ada0c2e2734f92bd3009ddbd717759&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:06.155452 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589575c-51fd-4818-8f68-74de2cd43c24 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:06.205727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369de7c1-e957-4083-8601-7344480789ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:06.206301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de7c1-e957-4083-8601-7344480789ed None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:06.206613 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de7c1-e957-4083-8601-7344480789ed None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:06.206888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de7c1-e957-4083-8601-7344480789ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:06.283608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369de7c1-e957-4083-8601-7344480789ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:06.285110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369de7c1-e957-4083-8601-7344480789ed None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:06.320010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:06.402859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 48/95] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:06.413810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd06c70-15f3-4e1f-b1aa-98439a37c3af None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:06.542777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd06c70-15f3-4e1f-b1aa-98439a37c3af None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:06.584895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48640b8-6833-4a06-9170-de56acf416da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:06.585393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48640b8-6833-4a06-9170-de56acf416da None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:06.585649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48640b8-6833-4a06-9170-de56acf416da None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:06.585928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48640b8-6833-4a06-9170-de56acf416da None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:06.587210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48640b8-6833-4a06-9170-de56acf416da None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:06.589364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48640b8-6833-4a06-9170-de56acf416da None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:06.591346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 48/96] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:06 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:06.597576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369de7c1-e957-4083-8601-7344480789ed None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:06.747137 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369de7c1-e957-4083-8601-7344480789ed None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:06.789571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:06.795817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5a539-6c32-4b06-9ea9-60fea8ff0bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:06.796380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a539-6c32-4b06-9ea9-60fea8ff0bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:06.796658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a539-6c32-4b06-9ea9-60fea8ff0bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:06.796930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a539-6c32-4b06-9ea9-60fea8ff0bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:06.797719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5a539-6c32-4b06-9ea9-60fea8ff0bc3 None admin] RBAC: Adding query filter params (role.id=42afac3d251b45ed822081a66ad20d6d, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5, user.id=1921ee40ca9a4f31b2382206170afd2f) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:06.798025 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5a539-6c32-4b06-9ea9-60fea8ff0bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:06.799625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5a539-6c32-4b06-9ea9-60fea8ff0bc3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:06.811089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 49/97] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:06 2022] GET /identity/v3/role_assignments?user.id=1921ee40ca9a4f31b2382206170afd2f&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=42afac3d251b45ed822081a66ad20d6d => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:08.316925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a013dc-1e93-49a4-96da-51beab2685f1 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:08.317454 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a013dc-1e93-49a4-96da-51beab2685f1 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:08.317454 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a013dc-1e93-49a4-96da-51beab2685f1 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:08.319050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 49/98] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:08.326906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1d950-091b-4e0c-a692-6ff3aaa5d6c7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:08.327730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1d950-091b-4e0c-a692-6ff3aaa5d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:08.328217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1d950-091b-4e0c-a692-6ff3aaa5d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:08.349010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3bf1d950-091b-4e0c-a692-6ff3aaa5d6c7 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:08.350559 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3bf1d950-091b-4e0c-a692-6ff3aaa5d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:08.448646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 50/99] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:08.482881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a013dc-1e93-49a4-96da-51beab2685f1 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:08.533286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:08.636274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a013dc-1e93-49a4-96da-51beab2685f1 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:08.679659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618378-f94b-49b9-a24f-37df62899081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:08.680306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618378-f94b-49b9-a24f-37df62899081 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:08.680595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618378-f94b-49b9-a24f-37df62899081 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:08.680873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618378-f94b-49b9-a24f-37df62899081 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:08.694615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d618378-f94b-49b9-a24f-37df62899081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-1d618378-f94b-49b9-a24f-37df62899081 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:08.700148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:08.701934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:08.702912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 50/100] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:08.707172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1d950-091b-4e0c-a692-6ff3aaa5d6c7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:08.720122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930d00-12a1-448f-9bb4-66b635d1c6cb None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:08.720428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930d00-12a1-448f-9bb4-66b635d1c6cb None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:08.720681 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930d00-12a1-448f-9bb4-66b635d1c6cb None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:08.722070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 51/101] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:08.745013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1669bf-c85f-4511-944e-69a20e073303 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:08.745881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1669bf-c85f-4511-944e-69a20e073303 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:08.745881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1669bf-c85f-4511-944e-69a20e073303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:08.780672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ae1669bf-c85f-4511-944e-69a20e073303 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:08.781889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ae1669bf-c85f-4511-944e-69a20e073303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:08.926816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 52/102] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:08.932994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1d950-091b-4e0c-a692-6ff3aaa5d6c7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:08.955789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1669bf-c85f-4511-944e-69a20e073303 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:09.002838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:09.006798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:09.023041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2143db-8342-45b4-bd44-6c605ff9ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:09.023700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2143db-8342-45b4-bd44-6c605ff9ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.023986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2143db-8342-45b4-bd44-6c605ff9ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.024265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2143db-8342-45b4-bd44-6c605ff9ffb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.025031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2143db-8342-45b4-bd44-6c605ff9ffb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:09.025345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2143db-8342-45b4-bd44-6c605ff9ffb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:09.026883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2143db-8342-45b4-bd44-6c605ff9ffb8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:09.047396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 51/103] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:09.065922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2143db-8342-45b4-bd44-6c605ff9ffb8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:09.143959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1669bf-c85f-4511-944e-69a20e073303 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:09.219288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba353df5-c9f7-4a5a-b63d-fc7261ff3bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:09.219875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353df5-c9f7-4a5a-b63d-fc7261ff3bed None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.220159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353df5-c9f7-4a5a-b63d-fc7261ff3bed None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.220429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353df5-c9f7-4a5a-b63d-fc7261ff3bed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.245268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba353df5-c9f7-4a5a-b63d-fc7261ff3bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-ba353df5-c9f7-4a5a-b63d-fc7261ff3bed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:09.253249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:09.254131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:09.255427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 53/104] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:09.257221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32798717-9759-49a4-8e17-0d4ffb2eb1b9 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.257617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32798717-9759-49a4-8e17-0d4ffb2eb1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.257905 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32798717-9759-49a4-8e17-0d4ffb2eb1b9 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.259399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 54/105] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:09.261016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd082ab7-ab9d-475b-8910-3b2099d4540a None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.261296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd082ab7-ab9d-475b-8910-3b2099d4540a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.261620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd082ab7-ab9d-475b-8910-3b2099d4540a None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.266838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 55/106] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:09.266838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8f52-55e6-4db1-9759-ff7531842e21 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.266838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8f52-55e6-4db1-9759-ff7531842e21 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.266838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8f52-55e6-4db1-9759-ff7531842e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.271085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2143db-8342-45b4-bd44-6c605ff9ffb8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:09.288442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-fbfa8f52-55e6-4db1-9759-ff7531842e21 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:09.289755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fbfa8f52-55e6-4db1-9759-ff7531842e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:09.324494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f685265-9ea0-4d06-bf11-c3f6cecc1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:09.325384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f685265-9ea0-4d06-bf11-c3f6cecc1417 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.325872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f685265-9ea0-4d06-bf11-c3f6cecc1417 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.327666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f685265-9ea0-4d06-bf11-c3f6cecc1417 None admin] PATH_INFO: `/v3/users/1921ee40ca9a4f31b2382206170afd2f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.329108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f685265-9ea0-4d06-bf11-c3f6cecc1417 None admin] RBAC: Authorizing `identity:get_user(user_id=1921ee40ca9a4f31b2382206170afd2f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:09.330764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f685265-9ea0-4d06-bf11-c3f6cecc1417 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:09.332935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 52/107] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:09 2022] GET /identity/v3/users/1921ee40ca9a4f31b2382206170afd2f => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:09.333924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f685265-9ea0-4d06-bf11-c3f6cecc1417 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:09.377629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 56/108] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:09.384178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ec8a4-f8c0-4d13-9f15-99896303d6f2 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.384933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ec8a4-f8c0-4d13-9f15-99896303d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.385866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ec8a4-f8c0-4d13-9f15-99896303d6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.396300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:09.412363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-310ec8a4-f8c0-4d13-9f15-99896303d6f2 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:09.414568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-310ec8a4-f8c0-4d13-9f15-99896303d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:09.430306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:09.444804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f685265-9ea0-4d06-bf11-c3f6cecc1417 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:09.481399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022af705-dd14-4b1b-ab6c-4d5b9867b1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:09.481957 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022af705-dd14-4b1b-ab6c-4d5b9867b1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.482246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022af705-dd14-4b1b-ab6c-4d5b9867b1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.482550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022af705-dd14-4b1b-ab6c-4d5b9867b1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.483279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022af705-dd14-4b1b-ab6c-4d5b9867b1a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:09.483588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022af705-dd14-4b1b-ab6c-4d5b9867b1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:09.484974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022af705-dd14-4b1b-ab6c-4d5b9867b1a1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:09.493412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 53/109] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:09.498796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022af705-dd14-4b1b-ab6c-4d5b9867b1a1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:09.507720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 57/110] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:09.509039 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa167c9-d3bd-483f-af7a-847889c86aea None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.509330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa167c9-d3bd-483f-af7a-847889c86aea None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.509330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa167c9-d3bd-483f-af7a-847889c86aea None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.509330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 58/111] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:09.511675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa167c9-d3bd-483f-af7a-847889c86aea None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:09.620257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022af705-dd14-4b1b-ab6c-4d5b9867b1a1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:09.623485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa167c9-d3bd-483f-af7a-847889c86aea None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:09.637636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:09.655397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc7479-96b3-4a93-9f43-99756652806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:09.656185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc7479-96b3-4a93-9f43-99756652806d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.656425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc7479-96b3-4a93-9f43-99756652806d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.656703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc7479-96b3-4a93-9f43-99756652806d None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.657863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc7479-96b3-4a93-9f43-99756652806d None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:09.658184 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1041d3-9170-41cf-8932-831ec78385da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:09.658963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1041d3-9170-41cf-8932-831ec78385da None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.659248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1041d3-9170-41cf-8932-831ec78385da None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.659338 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc7479-96b3-4a93-9f43-99756652806d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:09.659523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1041d3-9170-41cf-8932-831ec78385da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.661160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 54/112] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:09 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:09.665335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc7479-96b3-4a93-9f43-99756652806d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:09.671929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1041d3-9170-41cf-8932-831ec78385da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-0e1041d3-9170-41cf-8932-831ec78385da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:09.677016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:09.677843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:09.678667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 59/113] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:55:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:09.679757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71117dbd-ec45-477f-9fcb-3552f916b83f None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.679910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71117dbd-ec45-477f-9fcb-3552f916b83f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.680164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71117dbd-ec45-477f-9fcb-3552f916b83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.688586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:09.701044 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-71117dbd-ec45-477f-9fcb-3552f916b83f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:09.702492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-71117dbd-ec45-477f-9fcb-3552f916b83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:09.786538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 60/114] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:09.786538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71117dbd-ec45-477f-9fcb-3552f916b83f None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:09.791972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc7479-96b3-4a93-9f43-99756652806d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:09.829836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5c5dd-847b-42cf-afb2-93aadf53949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:09.830497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c5dd-847b-42cf-afb2-93aadf53949e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.830780 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c5dd-847b-42cf-afb2-93aadf53949e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.831051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5c5dd-847b-42cf-afb2-93aadf53949e None admin] PATH_INFO: `/v3/users/1921ee40ca9a4f31b2382206170afd2f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.832384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5c5dd-847b-42cf-afb2-93aadf53949e None admin] RBAC: Authorizing `identity:get_user(user_id=1921ee40ca9a4f31b2382206170afd2f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:09.833973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5c5dd-847b-42cf-afb2-93aadf53949e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:09.835879 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 55/115] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:09 2022] GET /identity/v3/users/1921ee40ca9a4f31b2382206170afd2f => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:09.836620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5c5dd-847b-42cf-afb2-93aadf53949e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:09.893303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71117dbd-ec45-477f-9fcb-3552f916b83f None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:09.900883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:09.929755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c2524-94dc-4eea-910c-5faba7e8ff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:09.930400 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c2524-94dc-4eea-910c-5faba7e8ff05 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.930713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c2524-94dc-4eea-910c-5faba7e8ff05 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.930983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c2524-94dc-4eea-910c-5faba7e8ff05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.932214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c2524-94dc-4eea-910c-5faba7e8ff05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:09.933683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c2524-94dc-4eea-910c-5faba7e8ff05 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:09.935317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 61/116] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:09.936080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c2524-94dc-4eea-910c-5faba7e8ff05 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:09.938568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:09.956988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5c5dd-847b-42cf-afb2-93aadf53949e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:09.994950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224f00-909e-4350-8163-22e5397ba109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:09.995621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224f00-909e-4350-8163-22e5397ba109 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:09.995904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224f00-909e-4350-8163-22e5397ba109 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:09.996318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224f00-909e-4350-8163-22e5397ba109 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/users/1921ee40ca9a4f31b2382206170afd2f/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:09.998122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95224f00-909e-4350-8163-22e5397ba109 None admin] RBAC: Authorizing `identity:create_grant(project_id=9874927d1bb641cba1df1d9d5a436cd5, user_id=1921ee40ca9a4f31b2382206170afd2f, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:09.999601 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95224f00-909e-4350-8163-22e5397ba109 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:10.022473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 56/117] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:55:09 2022] PUT /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/users/1921ee40ca9a4f31b2382206170afd2f/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:10.022473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224f00-909e-4350-8163-22e5397ba109 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:10.051989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c2524-94dc-4eea-910c-5faba7e8ff05 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:10.093456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b38308-470d-4d86-83d4-dc1e194ec9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:10.094096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b38308-470d-4d86-83d4-dc1e194ec9bc None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:10.094374 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b38308-470d-4d86-83d4-dc1e194ec9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:10.094678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b38308-470d-4d86-83d4-dc1e194ec9bc None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:10.095451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b38308-470d-4d86-83d4-dc1e194ec9bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:10.095759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b38308-470d-4d86-83d4-dc1e194ec9bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:10.097194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b38308-470d-4d86-83d4-dc1e194ec9bc None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:10.107059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 62/118] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:10.108021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b38308-470d-4d86-83d4-dc1e194ec9bc None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:10.148567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224f00-909e-4350-8163-22e5397ba109 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:10.164728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:10.180116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:10.193220 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba0ad2-52ee-480a-a054-678d1512d2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:10.193876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba0ad2-52ee-480a-a054-678d1512d2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:10.194154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba0ad2-52ee-480a-a054-678d1512d2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:10.194429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba0ad2-52ee-480a-a054-678d1512d2e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:10.206631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba0ad2-52ee-480a-a054-678d1512d2e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-26ba0ad2-52ee-480a-a054-678d1512d2e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:10.212061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:10.213531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:10.214302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 57/119] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:10.215431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba0ad2-52ee-480a-a054-678d1512d2e1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:10.236590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b38308-470d-4d86-83d4-dc1e194ec9bc None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:10.277583 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfd1ae-30a7-4a10-ad0c-4fd9ee616fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:10.278332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfd1ae-30a7-4a10-ad0c-4fd9ee616fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:10.278647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfd1ae-30a7-4a10-ad0c-4fd9ee616fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:10.278933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfd1ae-30a7-4a10-ad0c-4fd9ee616fe7 None admin] PATH_INFO: `/v3/projects/90ada0c2e2734f92bd3009ddbd717759` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:10.280114 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfd1ae-30a7-4a10-ad0c-4fd9ee616fe7 None admin] RBAC: Authorizing `identity:get_project(project_id=90ada0c2e2734f92bd3009ddbd717759)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:10.281577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfd1ae-30a7-4a10-ad0c-4fd9ee616fe7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:10.283302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 63/120] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:10 2022] GET /identity/v3/projects/90ada0c2e2734f92bd3009ddbd717759 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:10.284427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f1d6-7fc9-497f-b90c-f0315f456601 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:10.284711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f1d6-7fc9-497f-b90c-f0315f456601 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:10.284985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f1d6-7fc9-497f-b90c-f0315f456601 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:10.286325 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 64/121] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:10.291475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7f1d6-7fc9-497f-b90c-f0315f456601 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:10.327067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba0ad2-52ee-480a-a054-678d1512d2e1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:10.364141 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51998bde-2b8b-4df9-9806-d38b4bcb5ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:10.364923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998bde-2b8b-4df9-9806-d38b4bcb5ddd None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:10.365163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998bde-2b8b-4df9-9806-d38b4bcb5ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:10.365438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998bde-2b8b-4df9-9806-d38b4bcb5ddd None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:10.366125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51998bde-2b8b-4df9-9806-d38b4bcb5ddd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:10.367618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51998bde-2b8b-4df9-9806-d38b4bcb5ddd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:10.396903 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7f1d6-7fc9-497f-b90c-f0315f456601 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:10.397413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 58/122] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:55:10 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:10.398010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51998bde-2b8b-4df9-9806-d38b4bcb5ddd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:10.438965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:10.441447 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:10.446645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16aef5-d3c1-4ec6-905a-5eb27fcf146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:10.447467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16aef5-d3c1-4ec6-905a-5eb27fcf146f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:10.448037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16aef5-d3c1-4ec6-905a-5eb27fcf146f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:10.448037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16aef5-d3c1-4ec6-905a-5eb27fcf146f None admin] PATH_INFO: `/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:10.449386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16aef5-d3c1-4ec6-905a-5eb27fcf146f None admin] RBAC: Authorizing `identity:get_user(user_id=e93e6c9ab9a14e7ebbf8568b323f951e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:10.450919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16aef5-d3c1-4ec6-905a-5eb27fcf146f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:10.452765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 65/123] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:10 2022] GET /identity/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:10.458532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16aef5-d3c1-4ec6-905a-5eb27fcf146f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:10.549462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51998bde-2b8b-4df9-9806-d38b4bcb5ddd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:10.587250 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16aef5-d3c1-4ec6-905a-5eb27fcf146f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:10.604392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a513caf-0b87-4a8b-b79c-15bf2e41bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:10.604991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a513caf-0b87-4a8b-b79c-15bf2e41bec7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:10.605268 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a513caf-0b87-4a8b-b79c-15bf2e41bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:10.605540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a513caf-0b87-4a8b-b79c-15bf2e41bec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:10.606266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a513caf-0b87-4a8b-b79c-15bf2e41bec7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:10.606725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a513caf-0b87-4a8b-b79c-15bf2e41bec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:10.608112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a513caf-0b87-4a8b-b79c-15bf2e41bec7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:10.617056 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 59/124] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:10.618250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a357b-925f-44be-bdb4-a9cb672cf926 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:10.619655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a357b-925f-44be-bdb4-a9cb672cf926 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:10.619953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a357b-925f-44be-bdb4-a9cb672cf926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:10.640895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3f7a357b-925f-44be-bdb4-a9cb672cf926 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:10.642086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3f7a357b-925f-44be-bdb4-a9cb672cf926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:10.643183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fbf1d-b4de-4f78-80a8-04c2239927e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:10.644292 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fbf1d-b4de-4f78-80a8-04c2239927e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:10.645599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fbf1d-b4de-4f78-80a8-04c2239927e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:10.646168 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fbf1d-b4de-4f78-80a8-04c2239927e3 None admin] PATH_INFO: `/v3/projects/90ada0c2e2734f92bd3009ddbd717759/users/1921ee40ca9a4f31b2382206170afd2f/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:10.648734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fbf1d-b4de-4f78-80a8-04c2239927e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=90ada0c2e2734f92bd3009ddbd717759, user_id=1921ee40ca9a4f31b2382206170afd2f, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:10.651422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fbf1d-b4de-4f78-80a8-04c2239927e3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:10.669590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 66/125] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:55:10 2022] PUT /identity/v3/projects/90ada0c2e2734f92bd3009ddbd717759/users/1921ee40ca9a4f31b2382206170afd2f/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:10.671112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fbf1d-b4de-4f78-80a8-04c2239927e3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:10.772843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 60/126] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:10.773924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a357b-925f-44be-bdb4-a9cb672cf926 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:10.777807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:10.830835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:10.831591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fbf1d-b4de-4f78-80a8-04c2239927e3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:10.871537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d366e2d-7822-4bdf-a4fa-c59b3738d429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:10.872715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366e2d-7822-4bdf-a4fa-c59b3738d429 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:10.873194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366e2d-7822-4bdf-a4fa-c59b3738d429 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:10.873674 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366e2d-7822-4bdf-a4fa-c59b3738d429 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:10.875143 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d366e2d-7822-4bdf-a4fa-c59b3738d429 None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:10.877498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d366e2d-7822-4bdf-a4fa-c59b3738d429 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:10.879593 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 67/127] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:10 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:10.880803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d366e2d-7822-4bdf-a4fa-c59b3738d429 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:10.964516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a357b-925f-44be-bdb4-a9cb672cf926 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:11.002901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215425f4-3865-44cb-b0d3-85c642444d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:11.003654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215425f4-3865-44cb-b0d3-85c642444d17 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:11.003936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215425f4-3865-44cb-b0d3-85c642444d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:11.004204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215425f4-3865-44cb-b0d3-85c642444d17 None admin] PATH_INFO: `/v3/users/a7c2604a6a284a3eab799f587e736961` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:11.010833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d366e2d-7822-4bdf-a4fa-c59b3738d429 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:11.018233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215425f4-3865-44cb-b0d3-85c642444d17 None admin] RBAC: Authorizing `identity:get_user(user_id=a7c2604a6a284a3eab799f587e736961)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:11.019754 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215425f4-3865-44cb-b0d3-85c642444d17 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:11.021602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 61/128] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:10 2022] GET /identity/v3/users/a7c2604a6a284a3eab799f587e736961 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:11.022308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215425f4-3865-44cb-b0d3-85c642444d17 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:11.045765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:11.057002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cadf37-9f7a-4efa-b3c7-92ccab3e1bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:11.057962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cadf37-9f7a-4efa-b3c7-92ccab3e1bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:11.058472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cadf37-9f7a-4efa-b3c7-92ccab3e1bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:11.058952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cadf37-9f7a-4efa-b3c7-92ccab3e1bc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:11.070889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cadf37-9f7a-4efa-b3c7-92ccab3e1bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-75cadf37-9f7a-4efa-b3c7-92ccab3e1bc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:11.077389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:11.078228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:11.079026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:11.082310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 68/129] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:11.083511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cadf37-9f7a-4efa-b3c7-92ccab3e1bc4 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:11.166887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:11.199445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cadf37-9f7a-4efa-b3c7-92ccab3e1bc4 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:11.236846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8204074-b081-42ad-a774-6cb86a2cad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:11.237821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204074-b081-42ad-a774-6cb86a2cad81 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:11.238333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204074-b081-42ad-a774-6cb86a2cad81 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:11.238827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204074-b081-42ad-a774-6cb86a2cad81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:11.292985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215425f4-3865-44cb-b0d3-85c642444d17 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:11.310887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:11.321970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8204074-b081-42ad-a774-6cb86a2cad81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:11.323986 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8204074-b081-42ad-a774-6cb86a2cad81 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:11.402093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc015a-1c8e-427e-aef2-5427dbe7b7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:11.403482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc015a-1c8e-427e-aef2-5427dbe7b7b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:11.403962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc015a-1c8e-427e-aef2-5427dbe7b7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:11.404432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc015a-1c8e-427e-aef2-5427dbe7b7b4 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/users/e93e6c9ab9a14e7ebbf8568b323f951e/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:11.412231 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc015a-1c8e-427e-aef2-5427dbe7b7b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9874927d1bb641cba1df1d9d5a436cd5, user_id=e93e6c9ab9a14e7ebbf8568b323f951e, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:11.413920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc015a-1c8e-427e-aef2-5427dbe7b7b4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:11.438484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 62/130] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:55:11 2022] PUT /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/users/e93e6c9ab9a14e7ebbf8568b323f951e/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:11.439904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc015a-1c8e-427e-aef2-5427dbe7b7b4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:11.484437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 69/131] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:11.489785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8204074-b081-42ad-a774-6cb86a2cad81 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:11.669334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:11.686422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc015a-1c8e-427e-aef2-5427dbe7b7b4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:11.689525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8204074-b081-42ad-a774-6cb86a2cad81 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:11.734431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d63b0f-541f-4c2f-95b4-9c6c67758d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:11.735636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d63b0f-541f-4c2f-95b4-9c6c67758d83 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:11.736464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d63b0f-541f-4c2f-95b4-9c6c67758d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:11.737067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d63b0f-541f-4c2f-95b4-9c6c67758d83 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:11.738533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d63b0f-541f-4c2f-95b4-9c6c67758d83 None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:11.740307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d63b0f-541f-4c2f-95b4-9c6c67758d83 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:11.742211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 70/132] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:11 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:11.750645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d63b0f-541f-4c2f-95b4-9c6c67758d83 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:11.783736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b32b75-14b8-4592-8252-1314e1aba7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:11.784380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b32b75-14b8-4592-8252-1314e1aba7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:11.784663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b32b75-14b8-4592-8252-1314e1aba7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:11.784935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b32b75-14b8-4592-8252-1314e1aba7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:11.785659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b32b75-14b8-4592-8252-1314e1aba7f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:11.785962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b32b75-14b8-4592-8252-1314e1aba7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:11.787374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b32b75-14b8-4592-8252-1314e1aba7f3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:11.795855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:11.809122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 63/133] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:11.814638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b32b75-14b8-4592-8252-1314e1aba7f3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:11.864382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d63b0f-541f-4c2f-95b4-9c6c67758d83 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:11.906385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4650-328a-449f-a068-1112b83f62a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:11.907975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4650-328a-449f-a068-1112b83f62a2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:11.908259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4650-328a-449f-a068-1112b83f62a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:11.908534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4650-328a-449f-a068-1112b83f62a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:11.910546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4650-328a-449f-a068-1112b83f62a2 None admin] RBAC: Adding query filter params (role.id=771965b80b7e437fbedb3867eb4b6114, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5, user.id=a7c2604a6a284a3eab799f587e736961) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:11.912367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4650-328a-449f-a068-1112b83f62a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:11.916088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4650-328a-449f-a068-1112b83f62a2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:11.927665 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 71/134] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:11 2022] GET /identity/v3/role_assignments?user.id=a7c2604a6a284a3eab799f587e736961&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=771965b80b7e437fbedb3867eb4b6114 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:12.007805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b32b75-14b8-4592-8252-1314e1aba7f3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:12.072296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc848d-1c69-4d10-b0d8-41d0f5dd1d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:12.072977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc848d-1c69-4d10-b0d8-41d0f5dd1d77 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:12.073256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc848d-1c69-4d10-b0d8-41d0f5dd1d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:12.073527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc848d-1c69-4d10-b0d8-41d0f5dd1d77 None admin] PATH_INFO: `/v3/users/1921ee40ca9a4f31b2382206170afd2f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:12.074821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc848d-1c69-4d10-b0d8-41d0f5dd1d77 None admin] RBAC: Authorizing `identity:get_user(user_id=1921ee40ca9a4f31b2382206170afd2f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:12.076330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc848d-1c69-4d10-b0d8-41d0f5dd1d77 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:12.078018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 64/135] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:11 2022] GET /identity/v3/users/1921ee40ca9a4f31b2382206170afd2f => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:12.083620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4650-328a-449f-a068-1112b83f62a2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:12.146579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:12.298928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4650-328a-449f-a068-1112b83f62a2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:12.375471 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40d536-2756-4494-9ebd-6c6041704d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:12.376076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d536-2756-4494-9ebd-6c6041704d46 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:12.376365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d536-2756-4494-9ebd-6c6041704d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:12.376651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d536-2756-4494-9ebd-6c6041704d46 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:12.383200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40d536-2756-4494-9ebd-6c6041704d46 None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:12.385313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40d536-2756-4494-9ebd-6c6041704d46 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:12.387410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 72/136] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:12 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:12.407763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc848d-1c69-4d10-b0d8-41d0f5dd1d77 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:12.534777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b344286-98de-483e-a5cf-0c6dca4b0b7b None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:12.535262 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b344286-98de-483e-a5cf-0c6dca4b0b7b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:12.535355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b344286-98de-483e-a5cf-0c6dca4b0b7b None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:12.542477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 73/137] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:12.550823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:12.556430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392720-7507-416d-9be5-7f07d79fab8b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:12.556430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392720-7507-416d-9be5-7f07d79fab8b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:12.556430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392720-7507-416d-9be5-7f07d79fab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:12.625155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-be392720-7507-416d-9be5-7f07d79fab8b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:12.626360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-be392720-7507-416d-9be5-7f07d79fab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:12.646244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc848d-1c69-4d10-b0d8-41d0f5dd1d77 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:12.734017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16dd7e-2f6e-4ba4-8f0b-7b4addd89a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:12.734869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16dd7e-2f6e-4ba4-8f0b-7b4addd89a2a None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:12.735139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16dd7e-2f6e-4ba4-8f0b-7b4addd89a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:12.735420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16dd7e-2f6e-4ba4-8f0b-7b4addd89a2a None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/users/1921ee40ca9a4f31b2382206170afd2f/roles/42afac3d251b45ed822081a66ad20d6d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:12.751399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16dd7e-2f6e-4ba4-8f0b-7b4addd89a2a None admin] RBAC: Authorizing `identity:create_grant(project_id=9874927d1bb641cba1df1d9d5a436cd5, user_id=1921ee40ca9a4f31b2382206170afd2f, role_id=42afac3d251b45ed822081a66ad20d6d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:12.752330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16dd7e-2f6e-4ba4-8f0b-7b4addd89a2a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:12.811842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 65/138] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:55:12 2022] PUT /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/users/1921ee40ca9a4f31b2382206170afd2f/roles/42afac3d251b45ed822081a66ad20d6d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:12.844718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 74/139] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:12.887864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16dd7e-2f6e-4ba4-8f0b-7b4addd89a2a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:13.020968 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16dd7e-2f6e-4ba4-8f0b-7b4addd89a2a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:13.048998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:13.062711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7fcd4-7a2b-468c-abc0-26d5c5f45b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:13.064269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7fcd4-7a2b-468c-abc0-26d5c5f45b62 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:13.064772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7fcd4-7a2b-468c-abc0-26d5c5f45b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:13.065511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7fcd4-7a2b-468c-abc0-26d5c5f45b62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:13.083160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7fcd4-7a2b-468c-abc0-26d5c5f45b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6ed7fcd4-7a2b-468c-abc0-26d5c5f45b62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:13.089042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:13.089915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:13.090716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:13.097480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 66/140] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:13.098819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be392720-7507-416d-9be5-7f07d79fab8b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:13.131802 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:13.225937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be392720-7507-416d-9be5-7f07d79fab8b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:13.265679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e998a2-1b2c-4c89-b78f-f108867d8b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:13.266306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e998a2-1b2c-4c89-b78f-f108867d8b11 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:13.266642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e998a2-1b2c-4c89-b78f-f108867d8b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:13.266923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e998a2-1b2c-4c89-b78f-f108867d8b11 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:13.267653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e998a2-1b2c-4c89-b78f-f108867d8b11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:13.267958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e998a2-1b2c-4c89-b78f-f108867d8b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:13.269363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e998a2-1b2c-4c89-b78f-f108867d8b11 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:13.284000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 75/141] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:13.297131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7fcd4-7a2b-468c-abc0-26d5c5f45b62 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:13.450308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7fcd4-7a2b-468c-abc0-26d5c5f45b62 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:13.499650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2336e-1368-46d3-837a-4c2d743fb8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:13.500310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2336e-1368-46d3-837a-4c2d743fb8da None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:13.500598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2336e-1368-46d3-837a-4c2d743fb8da None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:13.500878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2336e-1368-46d3-837a-4c2d743fb8da None admin] PATH_INFO: `/v3/users/1921ee40ca9a4f31b2382206170afd2f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:13.507150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2336e-1368-46d3-837a-4c2d743fb8da None admin] RBAC: Authorizing `identity:get_user(user_id=1921ee40ca9a4f31b2382206170afd2f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:13.508702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2336e-1368-46d3-837a-4c2d743fb8da None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:13.510381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 67/142] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:13 2022] GET /identity/v3/users/1921ee40ca9a4f31b2382206170afd2f => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:13.519563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e998a2-1b2c-4c89-b78f-f108867d8b11 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:13.561729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20b19-4dd9-4700-b1e4-c6f6acdb62e4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:13.562056 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20b19-4dd9-4700-b1e4-c6f6acdb62e4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:13.562304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20b19-4dd9-4700-b1e4-c6f6acdb62e4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:13.563819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 68/143] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:13.584418 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d410db-a8ae-44c8-9e97-9c03c02621da None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:13.585732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d410db-a8ae-44c8-9e97-9c03c02621da None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:13.585732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d410db-a8ae-44c8-9e97-9c03c02621da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:13.623371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:13.624590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-26d410db-a8ae-44c8-9e97-9c03c02621da None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:13.625825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-26d410db-a8ae-44c8-9e97-9c03c02621da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:13.638426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e998a2-1b2c-4c89-b78f-f108867d8b11 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:13.692627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbc25f-c5eb-476e-84e9-df170d3da3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:13.693284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc25f-c5eb-476e-84e9-df170d3da3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:13.693649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc25f-c5eb-476e-84e9-df170d3da3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:13.693957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc25f-c5eb-476e-84e9-df170d3da3f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:13.742930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:13.748262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 69/144] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:13.772660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbc25f-c5eb-476e-84e9-df170d3da3f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:13.774133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbc25f-c5eb-476e-84e9-df170d3da3f6 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:13.792454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d410db-a8ae-44c8-9e97-9c03c02621da None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:13.859528 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:13.876547 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 76/145] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:13.877956 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db885b1-3cce-4c4d-ac33-1c0604836678 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:13.878348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db885b1-3cce-4c4d-ac33-1c0604836678 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:13.878801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db885b1-3cce-4c4d-ac33-1c0604836678 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:13.882672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 77/146] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:13.883749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db885b1-3cce-4c4d-ac33-1c0604836678 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:13.987950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db885b1-3cce-4c4d-ac33-1c0604836678 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:14.026032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb86b8-fea3-4d3f-a72e-d7e70a048497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:14.026032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb86b8-fea3-4d3f-a72e-d7e70a048497 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.026032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb86b8-fea3-4d3f-a72e-d7e70a048497 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.026032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb86b8-fea3-4d3f-a72e-d7e70a048497 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.026839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb86b8-fea3-4d3f-a72e-d7e70a048497 None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:14.029704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb86b8-fea3-4d3f-a72e-d7e70a048497 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:14.032143 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 78/147] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:13 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:14.036450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eac9e-6a8e-4e21-9167-66ef03c1d9a3 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.036450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eac9e-6a8e-4e21-9167-66ef03c1d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.036450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eac9e-6a8e-4e21-9167-66ef03c1d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.038929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d410db-a8ae-44c8-9e97-9c03c02621da None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:14.058479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a55eac9e-6a8e-4e21-9167-66ef03c1d9a3 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:14.058479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a55eac9e-6a8e-4e21-9167-66ef03c1d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:14.104349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:14.125247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 79/148] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:14.130461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55eac9e-6a8e-4e21-9167-66ef03c1d9a3 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:14.131863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e7770-2172-494e-b4d8-f72f4b9254dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:14.132682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e7770-2172-494e-b4d8-f72f4b9254dd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.133124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e7770-2172-494e-b4d8-f72f4b9254dd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.133535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e7770-2172-494e-b4d8-f72f4b9254dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.139299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e7770-2172-494e-b4d8-f72f4b9254dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:14.141141 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e7770-2172-494e-b4d8-f72f4b9254dd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:14.143256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 70/149] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:14.149083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e7770-2172-494e-b4d8-f72f4b9254dd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:14.242813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:14.250017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55eac9e-6a8e-4e21-9167-66ef03c1d9a3 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:14.285559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aada00d-a420-4759-a47a-a4b4bf9ca0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:14.286093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aada00d-a420-4759-a47a-a4b4bf9ca0cd None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.286372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aada00d-a420-4759-a47a-a4b4bf9ca0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.286677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aada00d-a420-4759-a47a-a4b4bf9ca0cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.287472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aada00d-a420-4759-a47a-a4b4bf9ca0cd None admin] RBAC: Adding query filter params (role.id=55fc2032ca914d2fb1ec5cbd52f60e54, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5, user.id=1921ee40ca9a4f31b2382206170afd2f) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:14.287779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aada00d-a420-4759-a47a-a4b4bf9ca0cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:14.289252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aada00d-a420-4759-a47a-a4b4bf9ca0cd None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:14.296102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 80/150] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:14 2022] GET /identity/v3/role_assignments?user.id=1921ee40ca9a4f31b2382206170afd2f&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:14.296914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aada00d-a420-4759-a47a-a4b4bf9ca0cd None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:14.312084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e7770-2172-494e-b4d8-f72f4b9254dd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:14.346997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:14.399758 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2d4a8-96e3-4a56-9ef6-4caa1ddfe665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:14.400938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2d4a8-96e3-4a56-9ef6-4caa1ddfe665 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.401222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2d4a8-96e3-4a56-9ef6-4caa1ddfe665 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.401500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2d4a8-96e3-4a56-9ef6-4caa1ddfe665 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.402195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2d4a8-96e3-4a56-9ef6-4caa1ddfe665 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:14.403706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2d4a8-96e3-4a56-9ef6-4caa1ddfe665 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:14.406566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aada00d-a420-4759-a47a-a4b4bf9ca0cd None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:14.445253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120936d8-a4bd-4aa7-9b84-4043d65d6316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:14.445919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120936d8-a4bd-4aa7-9b84-4043d65d6316 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.446209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120936d8-a4bd-4aa7-9b84-4043d65d6316 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.446515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120936d8-a4bd-4aa7-9b84-4043d65d6316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.458953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120936d8-a4bd-4aa7-9b84-4043d65d6316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:14.461607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 71/151] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:14 2022] POST /identity/v3/users => generated 283 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 01:55:14.463467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6ce49-b079-4d06-a3fc-4675a2c9e690 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.463758 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6ce49-b079-4d06-a3fc-4675a2c9e690 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.464035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6ce49-b079-4d06-a3fc-4675a2c9e690 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-120936d8-a4bd-4aa7-9b84-4043d65d6316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:14.465043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:14.465854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:14.467339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:14.468729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 72/152] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:14.468859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 81/153] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:14.471438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794d400-a76c-4722-b9a4-14ad79460da7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.471703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794d400-a76c-4722-b9a4-14ad79460da7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.471984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794d400-a76c-4722-b9a4-14ad79460da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.475705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120936d8-a4bd-4aa7-9b84-4043d65d6316 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:14.515669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d794d400-a76c-4722-b9a4-14ad79460da7 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:14.516920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d794d400-a76c-4722-b9a4-14ad79460da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:14.593427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120936d8-a4bd-4aa7-9b84-4043d65d6316 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:14.596952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:14.635519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62614e33-ceb5-4ed5-a92b-09702a3a4481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:14.636261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62614e33-ceb5-4ed5-a92b-09702a3a4481 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.636428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62614e33-ceb5-4ed5-a92b-09702a3a4481 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.636677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62614e33-ceb5-4ed5-a92b-09702a3a4481 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.637416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62614e33-ceb5-4ed5-a92b-09702a3a4481 None admin] RBAC: Adding query filter params (name=member) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:14.637720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62614e33-ceb5-4ed5-a92b-09702a3a4481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:14.639337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62614e33-ceb5-4ed5-a92b-09702a3a4481 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:14.649842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 82/154] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:14.654811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 73/155] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:14.658482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62614e33-ceb5-4ed5-a92b-09702a3a4481 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:14.675426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794d400-a76c-4722-b9a4-14ad79460da7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:14.727629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:14.790364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62614e33-ceb5-4ed5-a92b-09702a3a4481 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:14.809576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794d400-a76c-4722-b9a4-14ad79460da7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:14.836270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba5521-8736-4e61-8e94-8f5149b5dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:14.837369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba5521-8736-4e61-8e94-8f5149b5dfff None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.838992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba5521-8736-4e61-8e94-8f5149b5dfff None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.839471 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba5521-8736-4e61-8e94-8f5149b5dfff None admin] PATH_INFO: `/v3/users/1921ee40ca9a4f31b2382206170afd2f` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.843540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba5521-8736-4e61-8e94-8f5149b5dfff None admin] RBAC: Authorizing `identity:get_user(user_id=1921ee40ca9a4f31b2382206170afd2f)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:14.845441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba5521-8736-4e61-8e94-8f5149b5dfff None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:14.847443 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 83/156] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:14 2022] GET /identity/v3/users/1921ee40ca9a4f31b2382206170afd2f => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:14.854371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0c28b-c843-4ef3-8d75-f8bfc1f0b2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:14.854996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba5521-8736-4e61-8e94-8f5149b5dfff None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:14.855100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c28b-c843-4ef3-8d75-f8bfc1f0b2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:14.855317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c28b-c843-4ef3-8d75-f8bfc1f0b2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:14.855591 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c28b-c843-4ef3-8d75-f8bfc1f0b2b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:14.867419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0c28b-c843-4ef3-8d75-f8bfc1f0b2b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0ae0c28b-c843-4ef3-8d75-f8bfc1f0b2b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:14.874010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:14.875149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:14.876004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 74/157] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:55:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:14.879325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0c28b-c843-4ef3-8d75-f8bfc1f0b2b0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:14.910963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:14.988576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:14.992172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0c28b-c843-4ef3-8d75-f8bfc1f0b2b0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:14.997006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba5521-8736-4e61-8e94-8f5149b5dfff None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:15.036912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f80b9-c4ff-44fc-b217-18b2c91a4d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:15.036912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f80b9-c4ff-44fc-b217-18b2c91a4d7b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:15.036912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f80b9-c4ff-44fc-b217-18b2c91a4d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:15.036912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f80b9-c4ff-44fc-b217-18b2c91a4d7b None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:15.037300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f80b9-c4ff-44fc-b217-18b2c91a4d7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:15.037300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f80b9-c4ff-44fc-b217-18b2c91a4d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:15.038485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f80b9-c4ff-44fc-b217-18b2c91a4d7b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:15.051735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 75/158] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:15.058194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f80b9-c4ff-44fc-b217-18b2c91a4d7b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:15.058725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d3059-1ebc-465e-a3b6-0ae2f9081530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:15.059645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3059-1ebc-465e-a3b6-0ae2f9081530 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:15.060177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3059-1ebc-465e-a3b6-0ae2f9081530 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:15.060641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3059-1ebc-465e-a3b6-0ae2f9081530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:15.162752 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d3059-1ebc-465e-a3b6-0ae2f9081530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:15.164543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d3059-1ebc-465e-a3b6-0ae2f9081530 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:15.206464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f80b9-c4ff-44fc-b217-18b2c91a4d7b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:15.228968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:15.268009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdee26b-ff4b-4fb0-b47a-e3aa818cb845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:15.269051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdee26b-ff4b-4fb0-b47a-e3aa818cb845 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:15.269523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdee26b-ff4b-4fb0-b47a-e3aa818cb845 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:15.269986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdee26b-ff4b-4fb0-b47a-e3aa818cb845 None admin] PATH_INFO: `/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:15.271528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdee26b-ff4b-4fb0-b47a-e3aa818cb845 None admin] RBAC: Authorizing `identity:get_user(user_id=e93e6c9ab9a14e7ebbf8568b323f951e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:15.274315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdee26b-ff4b-4fb0-b47a-e3aa818cb845 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:15.276198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 76/159] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:15 2022] GET /identity/v3/users/e93e6c9ab9a14e7ebbf8568b323f951e => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:15.283019 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdee26b-ff4b-4fb0-b47a-e3aa818cb845 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:15.325497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:15.341540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 84/160] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 01:55:15.347909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d3059-1ebc-465e-a3b6-0ae2f9081530 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:15.428412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdee26b-ff4b-4fb0-b47a-e3aa818cb845 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:15.472419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de94534-06ad-4dd6-becf-fa95868ea7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:15.474039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de94534-06ad-4dd6-becf-fa95868ea7da None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:15.474965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de94534-06ad-4dd6-becf-fa95868ea7da None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:15.475451 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de94534-06ad-4dd6-becf-fa95868ea7da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:15.491596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d3059-1ebc-465e-a3b6-0ae2f9081530 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:15.526337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:15.531774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435f01c-2e86-4e4f-9151-b3cb7accf0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:15.532778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435f01c-2e86-4e4f-9151-b3cb7accf0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:15.533368 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435f01c-2e86-4e4f-9151-b3cb7accf0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:15.533959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435f01c-2e86-4e4f-9151-b3cb7accf0f2 None admin] PATH_INFO: `/v3/projects/90ada0c2e2734f92bd3009ddbd717759` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:15.535284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435f01c-2e86-4e4f-9151-b3cb7accf0f2 None admin] RBAC: Authorizing `identity:get_project(project_id=90ada0c2e2734f92bd3009ddbd717759)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:15.536840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435f01c-2e86-4e4f-9151-b3cb7accf0f2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:15.538866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 85/161] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:15 2022] GET /identity/v3/projects/90ada0c2e2734f92bd3009ddbd717759 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:15.540061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd073e9-f7cc-4ae5-a521-c19a47ea18ac None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:15.540437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd073e9-f7cc-4ae5-a521-c19a47ea18ac None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:15.541371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd073e9-f7cc-4ae5-a521-c19a47ea18ac None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:15.542724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 86/162] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:15.547517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd073e9-f7cc-4ae5-a521-c19a47ea18ac None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:15.570054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de94534-06ad-4dd6-becf-fa95868ea7da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:15.572450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de94534-06ad-4dd6-becf-fa95868ea7da None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:15.628003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:15.720275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd073e9-f7cc-4ae5-a521-c19a47ea18ac None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:15.755426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 77/163] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:15.756802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7953-be3b-4e5c-9ab2-37304c5316e6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:15.757084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7953-be3b-4e5c-9ab2-37304c5316e6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:15.758657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7953-be3b-4e5c-9ab2-37304c5316e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:15.784018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30c571-9c76-4b18-bb20-c002b4bb84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:15.784692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30c571-9c76-4b18-bb20-c002b4bb84a8 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:15.785034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30c571-9c76-4b18-bb20-c002b4bb84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:15.785485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30c571-9c76-4b18-bb20-c002b4bb84a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:15.786287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30c571-9c76-4b18-bb20-c002b4bb84a8 None admin] RBAC: Adding query filter params (role.id=55fc2032ca914d2fb1ec5cbd52f60e54, scope.project.id=90ada0c2e2734f92bd3009ddbd717759, user.id=1921ee40ca9a4f31b2382206170afd2f) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:15.786619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30c571-9c76-4b18-bb20-c002b4bb84a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:15.788069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30c571-9c76-4b18-bb20-c002b4bb84a8 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:15.795156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 87/164] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:15 2022] GET /identity/v3/role_assignments?user.id=1921ee40ca9a4f31b2382206170afd2f&scope.project.id=90ada0c2e2734f92bd3009ddbd717759&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:15.795905 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30c571-9c76-4b18-bb20-c002b4bb84a8 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:15.798814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2ddf7953-be3b-4e5c-9ab2-37304c5316e6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:15.800057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2ddf7953-be3b-4e5c-9ab2-37304c5316e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:15.887079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:15.949999 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30c571-9c76-4b18-bb20-c002b4bb84a8 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:16.001682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600d33c-2d88-4323-8a8b-97ccbe136a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:16.002707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d33c-2d88-4323-8a8b-97ccbe136a89 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:16.003296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d33c-2d88-4323-8a8b-97ccbe136a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:16.003775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d33c-2d88-4323-8a8b-97ccbe136a89 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:16.005187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600d33c-2d88-4323-8a8b-97ccbe136a89 None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:16.006907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600d33c-2d88-4323-8a8b-97ccbe136a89 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:16.008805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 88/165] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:15 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:16.010499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf9466-ed29-4aa6-8b66-acacaabda3a4 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:16.010997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf9466-ed29-4aa6-8b66-acacaabda3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:16.011459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf9466-ed29-4aa6-8b66-acacaabda3a4 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:16.012912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 89/166] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:16.015233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf9466-ed29-4aa6-8b66-acacaabda3a4 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:16.020275 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 78/167] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:16.021605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940559-a103-4394-94bc-71d0090ee05c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:16.021935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940559-a103-4394-94bc-71d0090ee05c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:16.022215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940559-a103-4394-94bc-71d0090ee05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:16.054414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a7940559-a103-4394-94bc-71d0090ee05c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:16.055705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a7940559-a103-4394-94bc-71d0090ee05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:16.128943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf9466-ed29-4aa6-8b66-acacaabda3a4 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:16.160096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:16.166469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478ba21-950d-4f0e-a5b9-1f9b077f8b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:16.167560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478ba21-950d-4f0e-a5b9-1f9b077f8b88 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:16.168148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478ba21-950d-4f0e-a5b9-1f9b077f8b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:16.168609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478ba21-950d-4f0e-a5b9-1f9b077f8b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:16.169603 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478ba21-950d-4f0e-a5b9-1f9b077f8b88 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5, user.id=e93e6c9ab9a14e7ebbf8568b323f951e) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:16.170102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478ba21-950d-4f0e-a5b9-1f9b077f8b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:16.170585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:16.172843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478ba21-950d-4f0e-a5b9-1f9b077f8b88 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:16.179456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 90/168] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:16 2022] GET /identity/v3/role_assignments?user.id=e93e6c9ab9a14e7ebbf8568b323f951e&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:16.180514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478ba21-950d-4f0e-a5b9-1f9b077f8b88 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:16.196411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 79/169] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:16.236396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7940559-a103-4394-94bc-71d0090ee05c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:16.338197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478ba21-950d-4f0e-a5b9-1f9b077f8b88 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:16.427281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7940559-a103-4394-94bc-71d0090ee05c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:16.439861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a5454-057e-4889-a804-27949813038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:16.440781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a5454-057e-4889-a804-27949813038c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:16.441056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a5454-057e-4889-a804-27949813038c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:16.441326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a5454-057e-4889-a804-27949813038c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:16.468816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130411-ac5d-4977-97af-b081dd5da9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:16.470103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130411-ac5d-4977-97af-b081dd5da9ed None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:16.470711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130411-ac5d-4977-97af-b081dd5da9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:16.471181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130411-ac5d-4977-97af-b081dd5da9ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:16.475157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a5454-057e-4889-a804-27949813038c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-d62a5454-057e-4889-a804-27949813038c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:16.481467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:16.482362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:16.483176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 91/170] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:16.487100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f130411-ac5d-4977-97af-b081dd5da9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:16.488411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a5454-057e-4889-a804-27949813038c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8f130411-ac5d-4977-97af-b081dd5da9ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:16.492937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:16.493920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:16.494706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:16.497149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 80/171] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:16.502683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130411-ac5d-4977-97af-b081dd5da9ed None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:16.561068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:16.624520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130411-ac5d-4977-97af-b081dd5da9ed None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:16.628590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:16.668667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a2c79-9762-4f51-b5ee-9f1f9e2bc3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:16.669675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a2c79-9762-4f51-b5ee-9f1f9e2bc3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:16.670145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a2c79-9762-4f51-b5ee-9f1f9e2bc3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:16.670636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a2c79-9762-4f51-b5ee-9f1f9e2bc3f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:16.671653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a2c79-9762-4f51-b5ee-9f1f9e2bc3f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:16.672154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a2c79-9762-4f51-b5ee-9f1f9e2bc3f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:16.674353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a2c79-9762-4f51-b5ee-9f1f9e2bc3f8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:16.685749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 81/172] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:16.691615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a2c79-9762-4f51-b5ee-9f1f9e2bc3f8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:16.734671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a5454-057e-4889-a804-27949813038c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:16.774663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9786a-380a-4578-ac88-be857b5b5723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:16.776311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9786a-380a-4578-ac88-be857b5b5723 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:16.776782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9786a-380a-4578-ac88-be857b5b5723 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:16.777242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9786a-380a-4578-ac88-be857b5b5723 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:16.778155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9786a-380a-4578-ac88-be857b5b5723 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:16.778835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9786a-380a-4578-ac88-be857b5b5723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:16.780739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9786a-380a-4578-ac88-be857b5b5723 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:16.790330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 92/173] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:16.797476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9786a-380a-4578-ac88-be857b5b5723 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:16.891505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a2c79-9762-4f51-b5ee-9f1f9e2bc3f8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:16.902685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:16.910650 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9786a-380a-4578-ac88-be857b5b5723 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:16.928616 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:16.941351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f11ca5-a408-4fe6-b971-6c8ab854c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:16.941923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f11ca5-a408-4fe6-b971-6c8ab854c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:16.942200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f11ca5-a408-4fe6-b971-6c8ab854c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:16.942544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f11ca5-a408-4fe6-b971-6c8ab854c7d5 None admin] PATH_INFO: `/v3/users/1921ee40ca9a4f31b2382206170afd2f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:16.947691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f11ca5-a408-4fe6-b971-6c8ab854c7d5 None admin] RBAC: Authorizing `identity:get_user(user_id=1921ee40ca9a4f31b2382206170afd2f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:16.949174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f11ca5-a408-4fe6-b971-6c8ab854c7d5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:16.950844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 82/174] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:16 2022] GET /identity/v3/users/1921ee40ca9a4f31b2382206170afd2f => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:16.951310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac399196-133c-4c2b-9a12-8cf4500abdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:16.952239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac399196-133c-4c2b-9a12-8cf4500abdaa None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:16.952735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac399196-133c-4c2b-9a12-8cf4500abdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:16.953199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac399196-133c-4c2b-9a12-8cf4500abdaa None admin] PATH_INFO: `/v3/users/a7c2604a6a284a3eab799f587e736961` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:16.954723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac399196-133c-4c2b-9a12-8cf4500abdaa None admin] RBAC: Authorizing `identity:get_user(user_id=a7c2604a6a284a3eab799f587e736961)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:16.956163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f11ca5-a408-4fe6-b971-6c8ab854c7d5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:16.956676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac399196-133c-4c2b-9a12-8cf4500abdaa None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:16.958573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 93/175] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:16 2022] GET /identity/v3/users/a7c2604a6a284a3eab799f587e736961 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:16.966809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac399196-133c-4c2b-9a12-8cf4500abdaa None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:17.067369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f11ca5-a408-4fe6-b971-6c8ab854c7d5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:17.074359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac399196-133c-4c2b-9a12-8cf4500abdaa None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:17.113241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368648a8-b302-4440-a3bc-7b1d34241d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:17.113883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368648a8-b302-4440-a3bc-7b1d34241d45 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:17.114165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368648a8-b302-4440-a3bc-7b1d34241d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:17.114431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368648a8-b302-4440-a3bc-7b1d34241d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:17.139380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5937-9065-44bb-ad6e-768f3c1293ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:17.140344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5937-9065-44bb-ad6e-768f3c1293ff None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:17.140909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5937-9065-44bb-ad6e-768f3c1293ff None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:17.141191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5937-9065-44bb-ad6e-768f3c1293ff None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:17.142667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc5937-9065-44bb-ad6e-768f3c1293ff None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:17.144130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc5937-9065-44bb-ad6e-768f3c1293ff None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:17.146105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 94/176] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:16 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:17.152533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5937-9065-44bb-ad6e-768f3c1293ff None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:17.202789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:17.245984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368648a8-b302-4440-a3bc-7b1d34241d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:17.247473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368648a8-b302-4440-a3bc-7b1d34241d45 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:17.260450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:17.323551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5937-9065-44bb-ad6e-768f3c1293ff None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:17.392321 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f11f4-0dd0-4538-a27f-4b45f7501db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:17.392911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f11f4-0dd0-4538-a27f-4b45f7501db2 None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:17.393193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f11f4-0dd0-4538-a27f-4b45f7501db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:17.393470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f11f4-0dd0-4538-a27f-4b45f7501db2 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/users/a7c2604a6a284a3eab799f587e736961/roles/771965b80b7e437fbedb3867eb4b6114` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:17.401246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f11f4-0dd0-4538-a27f-4b45f7501db2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9874927d1bb641cba1df1d9d5a436cd5, user_id=a7c2604a6a284a3eab799f587e736961, role_id=771965b80b7e437fbedb3867eb4b6114)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:17.402764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f11f4-0dd0-4538-a27f-4b45f7501db2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:17.422059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 95/177] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:55:17 2022] PUT /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/users/a7c2604a6a284a3eab799f587e736961/roles/771965b80b7e437fbedb3867eb4b6114 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:17.469508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 83/178] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 01:55:17.474799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f11f4-0dd0-4538-a27f-4b45f7501db2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:17.602676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f11f4-0dd0-4538-a27f-4b45f7501db2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:17.618285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:17.641288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0fe45-2a1c-4552-b012-0ab1c78e6b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:17.641931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0fe45-2a1c-4552-b012-0ab1c78e6b8f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:17.642208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0fe45-2a1c-4552-b012-0ab1c78e6b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:17.642555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0fe45-2a1c-4552-b012-0ab1c78e6b8f None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:17.643685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0fe45-2a1c-4552-b012-0ab1c78e6b8f None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:17.645152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0fe45-2a1c-4552-b012-0ab1c78e6b8f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:17.646870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 96/179] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:17 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:17.653334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368648a8-b302-4440-a3bc-7b1d34241d45 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:17.744842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:17.764640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c66f0-8c5f-404d-9c3c-641a046b63f9 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:17.765127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c66f0-8c5f-404d-9c3c-641a046b63f9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:17.765198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c66f0-8c5f-404d-9c3c-641a046b63f9 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:17.766667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 97/180] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:55:17.771626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761ac3-db92-4feb-8174-15f48d334480 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:17.772155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761ac3-db92-4feb-8174-15f48d334480 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:17.772632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761ac3-db92-4feb-8174-15f48d334480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:17.778586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368648a8-b302-4440-a3bc-7b1d34241d45 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:17.799339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-20761ac3-db92-4feb-8174-15f48d334480 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:17.801746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-20761ac3-db92-4feb-8174-15f48d334480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:17.844932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a49a-6ffe-455b-8705-df8f6f3b76f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:17.845903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a49a-6ffe-455b-8705-df8f6f3b76f9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:17.846582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a49a-6ffe-455b-8705-df8f6f3b76f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:17.848094 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a49a-6ffe-455b-8705-df8f6f3b76f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:17.849125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239a49a-6ffe-455b-8705-df8f6f3b76f9 None admin] RBAC: Adding query filter params (role.id=42afac3d251b45ed822081a66ad20d6d, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5, user.id=1921ee40ca9a4f31b2382206170afd2f) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:17.849825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239a49a-6ffe-455b-8705-df8f6f3b76f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:17.852323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239a49a-6ffe-455b-8705-df8f6f3b76f9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:17.870755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 84/181] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:17 2022] GET /identity/v3/role_assignments?user.id=1921ee40ca9a4f31b2382206170afd2f&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=42afac3d251b45ed822081a66ad20d6d => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:17.924231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 98/182] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:17.949039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a49a-6ffe-455b-8705-df8f6f3b76f9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:18.060865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a49a-6ffe-455b-8705-df8f6f3b76f9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:18.097847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253b8b2-9261-45cf-b98b-6e64d114e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:18.098884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b8b2-9261-45cf-b98b-6e64d114e501 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.099387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b8b2-9261-45cf-b98b-6e64d114e501 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.099872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b8b2-9261-45cf-b98b-6e64d114e501 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.111524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253b8b2-9261-45cf-b98b-6e64d114e501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4253b8b2-9261-45cf-b98b-6e64d114e501 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:18.117500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:18.118419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:18.119779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:18.122300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 85/183] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:55:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:18.128344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20761ac3-db92-4feb-8174-15f48d334480 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:18.172039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfe3c0-5a9b-4ee7-a42a-a455ca810a8d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.172651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfe3c0-5a9b-4ee7-a42a-a455ca810a8d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.173119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfe3c0-5a9b-4ee7-a42a-a455ca810a8d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.175178 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 86/184] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:18.176538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1e493-e966-4eec-aa40-cbf8b8e8f852 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.177026 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1e493-e966-4eec-aa40-cbf8b8e8f852 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.177526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1e493-e966-4eec-aa40-cbf8b8e8f852 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.178991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 87/185] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:18.185540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c7a4e-bbf2-4113-935f-4793acedaf60 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.186093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c7a4e-bbf2-4113-935f-4793acedaf60 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.186606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c7a4e-bbf2-4113-935f-4793acedaf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.194186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:18.211567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a86c7a4e-bbf2-4113-935f-4793acedaf60 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:18.213127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a86c7a4e-bbf2-4113-935f-4793acedaf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:18.246736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20761ac3-db92-4feb-8174-15f48d334480 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:18.262993 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:18.294298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac71ae-cd99-4ca9-bb1f-90643faacf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:18.295446 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac71ae-cd99-4ca9-bb1f-90643faacf6a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.295906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac71ae-cd99-4ca9-bb1f-90643faacf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.296458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac71ae-cd99-4ca9-bb1f-90643faacf6a None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.297549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac71ae-cd99-4ca9-bb1f-90643faacf6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:18.298340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac71ae-cd99-4ca9-bb1f-90643faacf6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:18.300372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac71ae-cd99-4ca9-bb1f-90643faacf6a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:18.307908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 88/186] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:18.309480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9882-327d-488f-b0ef-7abd8f127f30 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.309768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9882-327d-488f-b0ef-7abd8f127f30 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.310040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9882-327d-488f-b0ef-7abd8f127f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.311401 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 99/187] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:18.318234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac71ae-cd99-4ca9-bb1f-90643faacf6a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:18.329386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-acfe9882-327d-488f-b0ef-7abd8f127f30 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:18.330945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-acfe9882-327d-488f-b0ef-7abd8f127f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:18.403598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 89/188] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:18.414602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9882-327d-488f-b0ef-7abd8f127f30 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:18.424348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac71ae-cd99-4ca9-bb1f-90643faacf6a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:18.460316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c61c7-8c10-453e-9cb0-1735aadff1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:18.460874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c61c7-8c10-453e-9cb0-1735aadff1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.461148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c61c7-8c10-453e-9cb0-1735aadff1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.461419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c61c7-8c10-453e-9cb0-1735aadff1c4 None admin] PATH_INFO: `/v3/users/e3978719f3b748c399523e1f99621ba0` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.475436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c61c7-8c10-453e-9cb0-1735aadff1c4 None admin] RBAC: Authorizing `identity:get_user(user_id=e3978719f3b748c399523e1f99621ba0)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:18.476888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c61c7-8c10-453e-9cb0-1735aadff1c4 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:18.477577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:18.479104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 100/189] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:18 2022] GET /identity/v3/users/e3978719f3b748c399523e1f99621ba0 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:18.479947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c61c7-8c10-453e-9cb0-1735aadff1c4 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:18.510737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:18.525221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9882-327d-488f-b0ef-7abd8f127f30 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:18.560603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a18bf-364b-45d8-84cc-b2dd191ef41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:18.561240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a18bf-364b-45d8-84cc-b2dd191ef41f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.561518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a18bf-364b-45d8-84cc-b2dd191ef41f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.561790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a18bf-364b-45d8-84cc-b2dd191ef41f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.572815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a18bf-364b-45d8-84cc-b2dd191ef41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3d0a18bf-364b-45d8-84cc-b2dd191ef41f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:18.577687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:18.578847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 90/190] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:18.579828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a18bf-364b-45d8-84cc-b2dd191ef41f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:18.591865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c61c7-8c10-453e-9cb0-1735aadff1c4 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:18.629349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53f82f-992c-46c0-97d7-d65b08f2fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:18.630196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f82f-992c-46c0-97d7-d65b08f2fc24 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.630659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f82f-992c-46c0-97d7-d65b08f2fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.631183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f82f-992c-46c0-97d7-d65b08f2fc24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.632521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53f82f-992c-46c0-97d7-d65b08f2fc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:18.634104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53f82f-992c-46c0-97d7-d65b08f2fc24 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:18.636314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 101/191] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:18.637338 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53f82f-992c-46c0-97d7-d65b08f2fc24 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:18.686586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a18bf-364b-45d8-84cc-b2dd191ef41f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:18.709607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:18.724633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a71df-0c49-4b69-a307-eed9285cc479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:18.725200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a71df-0c49-4b69-a307-eed9285cc479 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.725461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a71df-0c49-4b69-a307-eed9285cc479 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.725733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a71df-0c49-4b69-a307-eed9285cc479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.747120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:18.751693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53f82f-992c-46c0-97d7-d65b08f2fc24 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:18.792182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cd6d2-1b53-493f-9a65-798507966cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:18.792812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cd6d2-1b53-493f-9a65-798507966cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.793082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cd6d2-1b53-493f-9a65-798507966cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.793364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cd6d2-1b53-493f-9a65-798507966cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.794094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cd6d2-1b53-493f-9a65-798507966cc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:18.794403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cd6d2-1b53-493f-9a65-798507966cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:18.795841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cd6d2-1b53-493f-9a65-798507966cc1 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:18.796893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a71df-0c49-4b69-a307-eed9285cc479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:18.798364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a71df-0c49-4b69-a307-eed9285cc479 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:18.805706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 102/192] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:18.811215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cd6d2-1b53-493f-9a65-798507966cc1 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:18.923208 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 91/193] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:18.924069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a71df-0c49-4b69-a307-eed9285cc479 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:18.932532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cd6d2-1b53-493f-9a65-798507966cc1 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:18.949666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:18.967465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035de512-5120-4356-ad05-6c7deed8860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:18.968169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035de512-5120-4356-ad05-6c7deed8860f None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:18.968453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035de512-5120-4356-ad05-6c7deed8860f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:18.968727 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035de512-5120-4356-ad05-6c7deed8860f None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:18.969410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035de512-5120-4356-ad05-6c7deed8860f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:18.970971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035de512-5120-4356-ad05-6c7deed8860f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:18.992774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 103/194] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:18 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:18.993516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035de512-5120-4356-ad05-6c7deed8860f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:19.022920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:19.061045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a71df-0c49-4b69-a307-eed9285cc479 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:19.112179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052dee4-ccbb-4374-abeb-4d2bf51cbc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:19.112874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052dee4-ccbb-4374-abeb-4d2bf51cbc41 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:19.113155 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052dee4-ccbb-4374-abeb-4d2bf51cbc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:19.113910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052dee4-ccbb-4374-abeb-4d2bf51cbc41 None admin] PATH_INFO: `/v3/users/e3978719f3b748c399523e1f99621ba0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:19.115495 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052dee4-ccbb-4374-abeb-4d2bf51cbc41 None admin] RBAC: Authorizing `identity:get_user(user_id=e3978719f3b748c399523e1f99621ba0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:19.117834 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052dee4-ccbb-4374-abeb-4d2bf51cbc41 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:19.120277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 92/195] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:18 2022] GET /identity/v3/users/e3978719f3b748c399523e1f99621ba0 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:19.125549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052dee4-ccbb-4374-abeb-4d2bf51cbc41 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:19.128812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035de512-5120-4356-ad05-6c7deed8860f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:19.166698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7c91-c2fc-47fb-a6c5-f2405b219e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:19.167778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7c91-c2fc-47fb-a6c5-f2405b219e7a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:19.168275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7c91-c2fc-47fb-a6c5-f2405b219e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:19.168789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7c91-c2fc-47fb-a6c5-f2405b219e7a None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:19.170987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c7c91-c2fc-47fb-a6c5-f2405b219e7a None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:19.172739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c7c91-c2fc-47fb-a6c5-f2405b219e7a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:19.174679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 104/196] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:18 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:19.183336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7c91-c2fc-47fb-a6c5-f2405b219e7a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:19.231736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:19.246829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052dee4-ccbb-4374-abeb-4d2bf51cbc41 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:19.281747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:19.287344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ef94-ac2d-4aed-a115-76981124bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:19.287970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ef94-ac2d-4aed-a115-76981124bb0d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:19.288256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ef94-ac2d-4aed-a115-76981124bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:19.288521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ef94-ac2d-4aed-a115-76981124bb0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:19.300088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7c91-c2fc-47fb-a6c5-f2405b219e7a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:19.364246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c38396-778f-46dd-a946-2aceb6413cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:19.364871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c38396-778f-46dd-a946-2aceb6413cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:19.365148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c38396-778f-46dd-a946-2aceb6413cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:19.365414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c38396-778f-46dd-a946-2aceb6413cc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:19.366211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c38396-778f-46dd-a946-2aceb6413cc2 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a, user.id=e3978719f3b748c399523e1f99621ba0) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:19.366548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c38396-778f-46dd-a946-2aceb6413cc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:19.367996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c38396-778f-46dd-a946-2aceb6413cc2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:19.373882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 105/197] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:19 2022] GET /identity/v3/role_assignments?user.id=e3978719f3b748c399523e1f99621ba0&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:19.378581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ef94-ac2d-4aed-a115-76981124bb0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:19.380403 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ef94-ac2d-4aed-a115-76981124bb0d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:19.490217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:19.507628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 93/198] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 01:55:19.513768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c38396-778f-46dd-a946-2aceb6413cc2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:19.637939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c38396-778f-46dd-a946-2aceb6413cc2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:19.683807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7961a3-41dc-4ea3-9c9c-4b860135e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:19.684495 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7961a3-41dc-4ea3-9c9c-4b860135e750 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:19.684772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7961a3-41dc-4ea3-9c9c-4b860135e750 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:19.685094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7961a3-41dc-4ea3-9c9c-4b860135e750 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:19.686283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7961a3-41dc-4ea3-9c9c-4b860135e750 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:19.687862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7961a3-41dc-4ea3-9c9c-4b860135e750 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:19.689554 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 106/199] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:19 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:19.698048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ef94-ac2d-4aed-a115-76981124bb0d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:19.838341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ef94-ac2d-4aed-a115-76981124bb0d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:19.883992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46b9e2-0a11-41c4-82be-1e4bfb20d8ba None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:19.884476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46b9e2-0a11-41c4-82be-1e4bfb20d8ba None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:19.884572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46b9e2-0a11-41c4-82be-1e4bfb20d8ba None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:19.885911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 107/200] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:19.895050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbb0b3-a896-4cb4-999f-15fcb9dff62a None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:19.895330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbb0b3-a896-4cb4-999f-15fcb9dff62a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:19.895606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbb0b3-a896-4cb4-999f-15fcb9dff62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:19.898864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6774-f28b-4626-8678-5951e8dffed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:19.899486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6774-f28b-4626-8678-5951e8dffed5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:19.899767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6774-f28b-4626-8678-5951e8dffed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:19.900069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6774-f28b-4626-8678-5951e8dffed5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:19.900865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6774-f28b-4626-8678-5951e8dffed5 None admin] RBAC: Adding query filter params (role.id=42afac3d251b45ed822081a66ad20d6d, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a, user.id=e3978719f3b748c399523e1f99621ba0) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:19.901175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6774-f28b-4626-8678-5951e8dffed5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:19.902636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f6774-f28b-4626-8678-5951e8dffed5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:19.914176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 94/201] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:19 2022] GET /identity/v3/role_assignments?user.id=e3978719f3b748c399523e1f99621ba0&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=42afac3d251b45ed822081a66ad20d6d => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:19.926099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a5bbb0b3-a896-4cb4-999f-15fcb9dff62a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:19.927334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a5bbb0b3-a896-4cb4-999f-15fcb9dff62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:19.949429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:20.019453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 108/202] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:20.043258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6774-f28b-4626-8678-5951e8dffed5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:20.108205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:20.157284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f6774-f28b-4626-8678-5951e8dffed5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:20.192778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484c8a4-a2bc-424e-9c6f-d8d4c7088d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:20.193422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484c8a4-a2bc-424e-9c6f-d8d4c7088d4b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:20.193698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484c8a4-a2bc-424e-9c6f-d8d4c7088d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:20.193969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484c8a4-a2bc-424e-9c6f-d8d4c7088d4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:20.205095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484c8a4-a2bc-424e-9c6f-d8d4c7088d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b484c8a4-a2bc-424e-9c6f-d8d4c7088d4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:20.210581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:20.211409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:20.212175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 95/203] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:20.217912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbb0b3-a896-4cb4-999f-15fcb9dff62a None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:20.318368 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbb0b3-a896-4cb4-999f-15fcb9dff62a None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:20.352715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1c5c-c472-42c0-9384-c382a8cd4222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:20.353368 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1c5c-c472-42c0-9384-c382a8cd4222 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:20.353648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1c5c-c472-42c0-9384-c382a8cd4222 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:20.353920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1c5c-c472-42c0-9384-c382a8cd4222 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:20.354684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c1c5c-c472-42c0-9384-c382a8cd4222 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:20.354990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c1c5c-c472-42c0-9384-c382a8cd4222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:20.356441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c1c5c-c472-42c0-9384-c382a8cd4222 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:20.365105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 109/204] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:20.371193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484c8a4-a2bc-424e-9c6f-d8d4c7088d4b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:20.474875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484c8a4-a2bc-424e-9c6f-d8d4c7088d4b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:20.488632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:20.510354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f206ea-c7c6-4c25-85fc-c51dd5de7400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:20.511029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f206ea-c7c6-4c25-85fc-c51dd5de7400 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:20.511304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f206ea-c7c6-4c25-85fc-c51dd5de7400 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:20.511574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f206ea-c7c6-4c25-85fc-c51dd5de7400 None admin] PATH_INFO: `/v3/users/a7c2604a6a284a3eab799f587e736961` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:20.512757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f206ea-c7c6-4c25-85fc-c51dd5de7400 None admin] RBAC: Authorizing `identity:get_user(user_id=a7c2604a6a284a3eab799f587e736961)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:20.514276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f206ea-c7c6-4c25-85fc-c51dd5de7400 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:20.516272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 96/205] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:20 2022] GET /identity/v3/users/a7c2604a6a284a3eab799f587e736961 => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:20.523745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1c5c-c472-42c0-9384-c382a8cd4222 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:20.542289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:20.676190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1c5c-c472-42c0-9384-c382a8cd4222 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:20.723252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d398-3746-4ebb-ae9d-1c146fe5b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:20.723876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d398-3746-4ebb-ae9d-1c146fe5b786 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:20.724158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d398-3746-4ebb-ae9d-1c146fe5b786 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:20.724435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d398-3746-4ebb-ae9d-1c146fe5b786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:20.792857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d398-3746-4ebb-ae9d-1c146fe5b786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:20.794384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d398-3746-4ebb-ae9d-1c146fe5b786 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:20.805649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:20.915039 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 110/206] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:20.920420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f206ea-c7c6-4c25-85fc-c51dd5de7400 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:21.077032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f206ea-c7c6-4c25-85fc-c51dd5de7400 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:21.125734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a289b-9685-4e64-b51e-91eb6d2613a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:21.126459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a289b-9685-4e64-b51e-91eb6d2613a7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:21.126742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a289b-9685-4e64-b51e-91eb6d2613a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:21.127015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a289b-9685-4e64-b51e-91eb6d2613a7 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:21.128683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a289b-9685-4e64-b51e-91eb6d2613a7 None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:21.130713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a289b-9685-4e64-b51e-91eb6d2613a7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:21.132657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 97/207] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:20 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:21.143843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d398-3746-4ebb-ae9d-1c146fe5b786 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:21.294979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d398-3746-4ebb-ae9d-1c146fe5b786 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:21.313579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:21.350718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8082fb-156f-4b7a-8a92-c4b544d6699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:21.351695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8082fb-156f-4b7a-8a92-c4b544d6699a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:21.352188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8082fb-156f-4b7a-8a92-c4b544d6699a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:21.352677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8082fb-156f-4b7a-8a92-c4b544d6699a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:21.354809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8082fb-156f-4b7a-8a92-c4b544d6699a None admin] RBAC: Adding query filter params (role.id=771965b80b7e437fbedb3867eb4b6114, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5, user.id=a7c2604a6a284a3eab799f587e736961) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:21.355364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8082fb-156f-4b7a-8a92-c4b544d6699a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:21.357716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8082fb-156f-4b7a-8a92-c4b544d6699a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:21.370930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 111/208] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:21 2022] GET /identity/v3/role_assignments?user.id=a7c2604a6a284a3eab799f587e736961&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=771965b80b7e437fbedb3867eb4b6114 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:21.810730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5822710-c94b-40fe-8efa-7f318166f8c6 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:21.811091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5822710-c94b-40fe-8efa-7f318166f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:21.811296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5822710-c94b-40fe-8efa-7f318166f8c6 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:21.812654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 98/209] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:21.818383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24626c5-cec1-48f4-9445-14a9deed0fba None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:21.818647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24626c5-cec1-48f4-9445-14a9deed0fba None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:21.818926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24626c5-cec1-48f4-9445-14a9deed0fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:21.838179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e24626c5-cec1-48f4-9445-14a9deed0fba None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:21.839387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e24626c5-cec1-48f4-9445-14a9deed0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:21.895702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdd15-b77c-4a1a-ac8d-6f3402077430 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:21.896007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdd15-b77c-4a1a-ac8d-6f3402077430 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:21.898108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdd15-b77c-4a1a-ac8d-6f3402077430 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:21.898108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 99/210] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:21.903408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071de574-55f6-42c4-8e07-a0fd44832ac3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:21.903661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071de574-55f6-42c4-8e07-a0fd44832ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:21.903936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071de574-55f6-42c4-8e07-a0fd44832ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:21.925208 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-071de574-55f6-42c4-8e07-a0fd44832ac3 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:21.926398 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-071de574-55f6-42c4-8e07-a0fd44832ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:21.936663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 112/211] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:21.943110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690b00d-87ee-4f72-8de2-f4dcb8a3aa15 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:21.943399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690b00d-87ee-4f72-8de2-f4dcb8a3aa15 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:21.943680 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690b00d-87ee-4f72-8de2-f4dcb8a3aa15 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:21.945145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 113/212] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:55:21.950702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069a7f-91ed-4751-bbe0-26cb96f59550 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:21.950989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069a7f-91ed-4751-bbe0-26cb96f59550 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:21.951287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069a7f-91ed-4751-bbe0-26cb96f59550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:21.970752 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-c9069a7f-91ed-4751-bbe0-26cb96f59550 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:21.971940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c9069a7f-91ed-4751-bbe0-26cb96f59550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:21.993281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:22.018847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 100/213] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:22.019698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071de574-55f6-42c4-8e07-a0fd44832ac3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.049771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 114/214] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:22.051084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9069a7f-91ed-4751-bbe0-26cb96f59550 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.090295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:22.137577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071de574-55f6-42c4-8e07-a0fd44832ac3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:22.160765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9069a7f-91ed-4751-bbe0-26cb96f59550 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:22.173971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bca27-087a-499a-840d-b2519c696338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:22.174643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bca27-087a-499a-840d-b2519c696338 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.174926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bca27-087a-499a-840d-b2519c696338 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.175200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bca27-087a-499a-840d-b2519c696338 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.186102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bca27-087a-499a-840d-b2519c696338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-457bca27-087a-499a-840d-b2519c696338 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:22.191310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:22.192153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:22.192941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 101/215] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:22.193578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bca27-087a-499a-840d-b2519c696338 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.204103 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf297bf-a2e7-49ea-a564-4c24ea97cce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:22.204753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf297bf-a2e7-49ea-a564-4c24ea97cce8 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.205035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf297bf-a2e7-49ea-a564-4c24ea97cce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.205308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf297bf-a2e7-49ea-a564-4c24ea97cce8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.206760 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf297bf-a2e7-49ea-a564-4c24ea97cce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:22.208001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf297bf-a2e7-49ea-a564-4c24ea97cce8 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:22.209630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 115/216] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:22.209630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf297bf-a2e7-49ea-a564-4c24ea97cce8 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.245319 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:22.309058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bca27-087a-499a-840d-b2519c696338 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:22.318729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf297bf-a2e7-49ea-a564-4c24ea97cce8 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:22.320379 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:22.348600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5ed3e-c500-432c-808c-809fd6a1851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:22.349269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5ed3e-c500-432c-808c-809fd6a1851b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.349452 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5ed3e-c500-432c-808c-809fd6a1851b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.349723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5ed3e-c500-432c-808c-809fd6a1851b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.355881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121650c-f0bf-44dd-b212-0b18290826ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:22.356489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121650c-f0bf-44dd-b212-0b18290826ea None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.356765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121650c-f0bf-44dd-b212-0b18290826ea None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.357033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121650c-f0bf-44dd-b212-0b18290826ea None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.357840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121650c-f0bf-44dd-b212-0b18290826ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:22.358153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121650c-f0bf-44dd-b212-0b18290826ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:22.359568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121650c-f0bf-44dd-b212-0b18290826ea None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:22.360828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5ed3e-c500-432c-808c-809fd6a1851b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4bb5ed3e-c500-432c-808c-809fd6a1851b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:22.365731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:22.366798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 102/217] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:55:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:22.373173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5ed3e-c500-432c-808c-809fd6a1851b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.378757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 116/218] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:22.378757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7cd2a-92d4-4c11-a65b-d58724cffc66 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.378757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7cd2a-92d4-4c11-a65b-d58724cffc66 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.378757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7cd2a-92d4-4c11-a65b-d58724cffc66 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.378757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 117/219] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:22.378757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7cd2a-92d4-4c11-a65b-d58724cffc66 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.466332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:22.469295 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5ed3e-c500-432c-808c-809fd6a1851b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:22.479388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7cd2a-92d4-4c11-a65b-d58724cffc66 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:22.505510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc62f46-0c84-4b94-af08-68360f92f744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:22.506160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc62f46-0c84-4b94-af08-68360f92f744 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.506450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc62f46-0c84-4b94-af08-68360f92f744 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.506731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc62f46-0c84-4b94-af08-68360f92f744 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.507415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc62f46-0c84-4b94-af08-68360f92f744 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:22.508871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc62f46-0c84-4b94-af08-68360f92f744 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:22.512591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427517a-af88-4d2c-8763-a654c6cb1674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:22.513195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427517a-af88-4d2c-8763-a654c6cb1674 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.513473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427517a-af88-4d2c-8763-a654c6cb1674 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.513745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427517a-af88-4d2c-8763-a654c6cb1674 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.514481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427517a-af88-4d2c-8763-a654c6cb1674 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:22.514789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427517a-af88-4d2c-8763-a654c6cb1674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:22.516157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427517a-af88-4d2c-8763-a654c6cb1674 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:22.529927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 118/220] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:22.529927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427517a-af88-4d2c-8763-a654c6cb1674 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.532734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 103/221] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:22 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:22.533949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add56e17-af9e-460d-bde7-81b10bec27be None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.534246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add56e17-af9e-460d-bde7-81b10bec27be None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.534558 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add56e17-af9e-460d-bde7-81b10bec27be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.557978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-add56e17-af9e-460d-bde7-81b10bec27be None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:22.559649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-add56e17-af9e-460d-bde7-81b10bec27be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:22.568387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:22.638193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 104/222] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:22.638819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add56e17-af9e-460d-bde7-81b10bec27be None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.657747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427517a-af88-4d2c-8763-a654c6cb1674 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:22.697586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9705d3-84eb-454b-823b-11aac7ee6853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:22.698325 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9705d3-84eb-454b-823b-11aac7ee6853 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.698656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9705d3-84eb-454b-823b-11aac7ee6853 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.698927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9705d3-84eb-454b-823b-11aac7ee6853 None admin] PATH_INFO: `/v3/users/2b8810c240104da3b96b52693c5615ec` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.713102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9705d3-84eb-454b-823b-11aac7ee6853 None admin] RBAC: Authorizing `identity:get_user(user_id=2b8810c240104da3b96b52693c5615ec)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:22.714636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9705d3-84eb-454b-823b-11aac7ee6853 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:22.716349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 119/223] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:22 2022] GET /identity/v3/users/2b8810c240104da3b96b52693c5615ec => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:22.717118 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9705d3-84eb-454b-823b-11aac7ee6853 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.738989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:22.758542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add56e17-af9e-460d-bde7-81b10bec27be None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:22.804136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17698a-de66-4ad6-9fee-c03a2b59842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:22.804800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17698a-de66-4ad6-9fee-c03a2b59842b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.805082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17698a-de66-4ad6-9fee-c03a2b59842b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.805359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17698a-de66-4ad6-9fee-c03a2b59842b None admin] PATH_INFO: `/v3/users/e3978719f3b748c399523e1f99621ba0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.807239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17698a-de66-4ad6-9fee-c03a2b59842b None admin] RBAC: Authorizing `identity:get_user(user_id=e3978719f3b748c399523e1f99621ba0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:22.808690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17698a-de66-4ad6-9fee-c03a2b59842b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:22.814796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 105/224] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:22 2022] GET /identity/v3/users/e3978719f3b748c399523e1f99621ba0 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:22.815741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17698a-de66-4ad6-9fee-c03a2b59842b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.838388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:22.859483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9705d3-84eb-454b-823b-11aac7ee6853 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:22.904732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d7d3-1fcb-40ff-b072-5ebf863c40f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:22.905309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d7d3-1fcb-40ff-b072-5ebf863c40f2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:22.905590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d7d3-1fcb-40ff-b072-5ebf863c40f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:22.905869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d7d3-1fcb-40ff-b072-5ebf863c40f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:22.917803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633d7d3-1fcb-40ff-b072-5ebf863c40f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-a633d7d3-1fcb-40ff-b072-5ebf863c40f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:22.922931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:22.924017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:22.924976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 120/225] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:22.925702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d7d3-1fcb-40ff-b072-5ebf863c40f2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:22.955323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17698a-de66-4ad6-9fee-c03a2b59842b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:23.004202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e016f8f-766c-4615-8021-43ac0a6d13a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:23.005066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e016f8f-766c-4615-8021-43ac0a6d13a4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:23.005485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e016f8f-766c-4615-8021-43ac0a6d13a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:23.005922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e016f8f-766c-4615-8021-43ac0a6d13a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:23.035348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d7d3-1fcb-40ff-b072-5ebf863c40f2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:23.044051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:23.073312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987423a4-07d0-4170-913c-974d9dd5e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:23.074055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987423a4-07d0-4170-913c-974d9dd5e528 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:23.074409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987423a4-07d0-4170-913c-974d9dd5e528 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:23.074783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987423a4-07d0-4170-913c-974d9dd5e528 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:23.076448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987423a4-07d0-4170-913c-974d9dd5e528 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:23.077815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987423a4-07d0-4170-913c-974d9dd5e528 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:23.079968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 121/226] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:22 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:23.085179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987423a4-07d0-4170-913c-974d9dd5e528 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:23.102255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:23.104788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e016f8f-766c-4615-8021-43ac0a6d13a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:23.106969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e016f8f-766c-4615-8021-43ac0a6d13a4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:23.215099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987423a4-07d0-4170-913c-974d9dd5e528 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:23.236145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 106/227] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:23.239306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e016f8f-766c-4615-8021-43ac0a6d13a4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:23.260839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306e1e1-e532-4afb-8589-9a3d7bf1c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:23.261511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306e1e1-e532-4afb-8589-9a3d7bf1c13b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:23.261954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306e1e1-e532-4afb-8589-9a3d7bf1c13b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:23.262235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306e1e1-e532-4afb-8589-9a3d7bf1c13b None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:23.263283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306e1e1-e532-4afb-8589-9a3d7bf1c13b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:23.263591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306e1e1-e532-4afb-8589-9a3d7bf1c13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:23.264983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306e1e1-e532-4afb-8589-9a3d7bf1c13b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:23.276200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 122/228] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:23.279062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306e1e1-e532-4afb-8589-9a3d7bf1c13b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:23.314739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:23.372959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e016f8f-766c-4615-8021-43ac0a6d13a4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:23.374530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:23.403605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306e1e1-e532-4afb-8589-9a3d7bf1c13b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:23.410937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08940e-e360-4245-9ad8-f60d3ca54880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:23.411708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08940e-e360-4245-9ad8-f60d3ca54880 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:23.412055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08940e-e360-4245-9ad8-f60d3ca54880 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:23.412395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08940e-e360-4245-9ad8-f60d3ca54880 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/users/e3978719f3b748c399523e1f99621ba0/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:23.414471 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08940e-e360-4245-9ad8-f60d3ca54880 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6ca290b26543f7b6f2d6086cfa623a, user_id=e3978719f3b748c399523e1f99621ba0, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:23.416688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08940e-e360-4245-9ad8-f60d3ca54880 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:23.431936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 107/229] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:55:23 2022] PUT /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/users/e3978719f3b748c399523e1f99621ba0/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:23.432961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08940e-e360-4245-9ad8-f60d3ca54880 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:23.455902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d3685-a104-47ac-a900-4f37cba0eb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:23.456566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3685-a104-47ac-a900-4f37cba0eb81 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:23.456851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3685-a104-47ac-a900-4f37cba0eb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:23.457129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3685-a104-47ac-a900-4f37cba0eb81 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:23.458868 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d3685-a104-47ac-a900-4f37cba0eb81 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:23.460354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d3685-a104-47ac-a900-4f37cba0eb81 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:23.466616 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 123/230] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:23 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:23.468589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d3685-a104-47ac-a900-4f37cba0eb81 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:23.547847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08940e-e360-4245-9ad8-f60d3ca54880 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:23.564869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:23.588907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277c8b9-9e70-4188-b781-5845831fa24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:23.589560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277c8b9-9e70-4188-b781-5845831fa24d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:23.589836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277c8b9-9e70-4188-b781-5845831fa24d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:23.590113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277c8b9-9e70-4188-b781-5845831fa24d None admin] PATH_INFO: `/v3/users/e3978719f3b748c399523e1f99621ba0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:23.591316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277c8b9-9e70-4188-b781-5845831fa24d None admin] RBAC: Authorizing `identity:get_user(user_id=e3978719f3b748c399523e1f99621ba0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:23.592784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277c8b9-9e70-4188-b781-5845831fa24d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:23.594402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 108/231] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:23 2022] GET /identity/v3/users/e3978719f3b748c399523e1f99621ba0 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:23.610427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277c8b9-9e70-4188-b781-5845831fa24d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:23.668582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d3685-a104-47ac-a900-4f37cba0eb81 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:23.719666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfd1b5-def2-435f-b9d1-4ec2c79cefb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:23.720624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfd1b5-def2-435f-b9d1-4ec2c79cefb2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:23.721098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfd1b5-def2-435f-b9d1-4ec2c79cefb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:23.721561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfd1b5-def2-435f-b9d1-4ec2c79cefb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:23.722604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfd1b5-def2-435f-b9d1-4ec2c79cefb2 None admin] RBAC: Adding query filter params (role.id=55fc2032ca914d2fb1ec5cbd52f60e54, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a, user.id=2b8810c240104da3b96b52693c5615ec) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:23.723109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfd1b5-def2-435f-b9d1-4ec2c79cefb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:23.724757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfd1b5-def2-435f-b9d1-4ec2c79cefb2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:23.731343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 124/232] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:23 2022] GET /identity/v3/role_assignments?user.id=2b8810c240104da3b96b52693c5615ec&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:23.769990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277c8b9-9e70-4188-b781-5845831fa24d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:23.810579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40c166-2fe4-4553-bed2-7057e859036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:23.811249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c166-2fe4-4553-bed2-7057e859036c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:23.811530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c166-2fe4-4553-bed2-7057e859036c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:23.811803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c166-2fe4-4553-bed2-7057e859036c None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:23.813101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40c166-2fe4-4553-bed2-7057e859036c None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:23.814620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40c166-2fe4-4553-bed2-7057e859036c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:23.816992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 109/233] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:23 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:23.823266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfd1b5-def2-435f-b9d1-4ec2c79cefb2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:23.834879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:23.950267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfd1b5-def2-435f-b9d1-4ec2c79cefb2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:23.985370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fb568-3865-4856-b5bf-86fde9e30235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:23.986021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fb568-3865-4856-b5bf-86fde9e30235 None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:23.986308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fb568-3865-4856-b5bf-86fde9e30235 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:23.986619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fb568-3865-4856-b5bf-86fde9e30235 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/users/e3978719f3b748c399523e1f99621ba0/roles/42afac3d251b45ed822081a66ad20d6d` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:23.988946 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fb568-3865-4856-b5bf-86fde9e30235 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6ca290b26543f7b6f2d6086cfa623a, user_id=e3978719f3b748c399523e1f99621ba0, role_id=42afac3d251b45ed822081a66ad20d6d)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:23.990413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fb568-3865-4856-b5bf-86fde9e30235 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:24.005390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 125/234] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:55:23 2022] PUT /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/users/e3978719f3b748c399523e1f99621ba0/roles/42afac3d251b45ed822081a66ad20d6d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:24.882884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374265-983b-4357-a44c-5687c07b2459 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:24.883353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374265-983b-4357-a44c-5687c07b2459 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:24.883429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374265-983b-4357-a44c-5687c07b2459 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:24.885047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 110/235] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:24.890375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9339bed-b54e-4dfe-a451-313d6a594c20 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:24.891248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9339bed-b54e-4dfe-a451-313d6a594c20 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:24.891757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9339bed-b54e-4dfe-a451-313d6a594c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:24.919428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e9339bed-b54e-4dfe-a451-313d6a594c20 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:24.920641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e9339bed-b54e-4dfe-a451-313d6a594c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:24.969269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25a3e-846c-4bcf-a968-d2686de99ca0 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:24.969590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25a3e-846c-4bcf-a968-d2686de99ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:24.969816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25a3e-846c-4bcf-a968-d2686de99ca0 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:24.971460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 111/236] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:24.977307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff9d83-a88a-4e56-94b9-0b21ab71ee60 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:24.977865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff9d83-a88a-4e56-94b9-0b21ab71ee60 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:24.978961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff9d83-a88a-4e56-94b9-0b21ab71ee60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:25.005265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:25.018308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 126/237] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:25.023374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-eeff9d83-a88a-4e56-94b9-0b21ab71ee60 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:25.024597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-eeff9d83-a88a-4e56-94b9-0b21ab71ee60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:25.059969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9339bed-b54e-4dfe-a451-313d6a594c20 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:25.109253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:25.150707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 112/238] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:25.175054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9339bed-b54e-4dfe-a451-313d6a594c20 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:25.187516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff9d83-a88a-4e56-94b9-0b21ab71ee60 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:25.212115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4761f6-0271-43cd-a524-0a604238d492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:25.213719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4761f6-0271-43cd-a524-0a604238d492 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:25.214008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4761f6-0271-43cd-a524-0a604238d492 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:25.214282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4761f6-0271-43cd-a524-0a604238d492 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:25.225301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4761f6-0271-43cd-a524-0a604238d492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-3b4761f6-0271-43cd-a524-0a604238d492 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:25.231014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:25.232121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:25.233038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 127/239] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:25.238303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4761f6-0271-43cd-a524-0a604238d492 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:25.302817 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:25.350793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4761f6-0271-43cd-a524-0a604238d492 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:25.390328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2220e-e07a-431d-90e1-b5298c36f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:25.390980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2220e-e07a-431d-90e1-b5298c36f85b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:25.391257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2220e-e07a-431d-90e1-b5298c36f85b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:25.391527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2220e-e07a-431d-90e1-b5298c36f85b None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:25.392257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2220e-e07a-431d-90e1-b5298c36f85b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:25.392562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2220e-e07a-431d-90e1-b5298c36f85b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:25.403002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2220e-e07a-431d-90e1-b5298c36f85b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:25.422938 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 128/240] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:25.430465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2220e-e07a-431d-90e1-b5298c36f85b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:25.465252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff9d83-a88a-4e56-94b9-0b21ab71ee60 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:25.524723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f49b-8370-49ba-9aa0-3714dd2aa409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:25.525408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f49b-8370-49ba-9aa0-3714dd2aa409 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:25.525685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f49b-8370-49ba-9aa0-3714dd2aa409 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:25.525957 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f49b-8370-49ba-9aa0-3714dd2aa409 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:25.534841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843f49b-8370-49ba-9aa0-3714dd2aa409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:25.536314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843f49b-8370-49ba-9aa0-3714dd2aa409 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:25.540248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 113/241] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:25.547549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f49b-8370-49ba-9aa0-3714dd2aa409 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:25.595945 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2220e-e07a-431d-90e1-b5298c36f85b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:25.632611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:25.644373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:25.660365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63432ce9-44e6-42fa-9d9d-4e1071f561a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:25.660936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63432ce9-44e6-42fa-9d9d-4e1071f561a3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:25.661217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63432ce9-44e6-42fa-9d9d-4e1071f561a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:25.661489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63432ce9-44e6-42fa-9d9d-4e1071f561a3 None admin] PATH_INFO: `/v3/users/6862b24f6c9644139152b0d795946b3a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:25.693937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63432ce9-44e6-42fa-9d9d-4e1071f561a3 None admin] RBAC: Authorizing `identity:get_user(user_id=6862b24f6c9644139152b0d795946b3a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:25.695445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63432ce9-44e6-42fa-9d9d-4e1071f561a3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:25.701570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 129/242] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:25 2022] GET /identity/v3/users/6862b24f6c9644139152b0d795946b3a => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:25.703168 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63432ce9-44e6-42fa-9d9d-4e1071f561a3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:25.746423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f49b-8370-49ba-9aa0-3714dd2aa409 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:25.833157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c525e7a-cab1-4cb0-896c-828a5d49b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:25.834143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c525e7a-cab1-4cb0-896c-828a5d49b220 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:25.834638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c525e7a-cab1-4cb0-896c-828a5d49b220 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:25.835126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c525e7a-cab1-4cb0-896c-828a5d49b220 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:25.836078 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c525e7a-cab1-4cb0-896c-828a5d49b220 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:25.837752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c525e7a-cab1-4cb0-896c-828a5d49b220 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:25.847975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63432ce9-44e6-42fa-9d9d-4e1071f561a3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:25.895680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 114/243] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:25 2022] POST /identity/v3/users => generated 293 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:25.900765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af0aa9-09b0-4430-8ddc-83b4ad4a29b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:25.901399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af0aa9-09b0-4430-8ddc-83b4ad4a29b5 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:25.901714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af0aa9-09b0-4430-8ddc-83b4ad4a29b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:25.901995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af0aa9-09b0-4430-8ddc-83b4ad4a29b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:25.997988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:26.030824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af0aa9-09b0-4430-8ddc-83b4ad4a29b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:26.032707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af0aa9-09b0-4430-8ddc-83b4ad4a29b5 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:26.047072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698816e7-0c02-44fd-afb2-047b8c798d87 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.047681 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698816e7-0c02-44fd-afb2-047b8c798d87 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.048172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698816e7-0c02-44fd-afb2-047b8c798d87 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.049753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 115/244] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:55:26.055161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b037-8204-4fb6-b738-10e94072f802 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.055708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b037-8204-4fb6-b738-10e94072f802 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.056794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b037-8204-4fb6-b738-10e94072f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.086201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5c13b037-8204-4fb6-b738-10e94072f802 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:26.087805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5c13b037-8204-4fb6-b738-10e94072f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:26.176491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 130/245] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:26.182852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af0aa9-09b0-4430-8ddc-83b4ad4a29b5 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:26.200539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 116/246] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:26.225913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b037-8204-4fb6-b738-10e94072f802 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:26.264751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:26.283007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:26.291269 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af0aa9-09b0-4430-8ddc-83b4ad4a29b5 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:26.327781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09a1c5-ffc1-4d5a-819f-96b092027bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:26.328482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09a1c5-ffc1-4d5a-819f-96b092027bfc None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.328759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09a1c5-ffc1-4d5a-819f-96b092027bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.329086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09a1c5-ffc1-4d5a-819f-96b092027bfc None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.330270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09a1c5-ffc1-4d5a-819f-96b092027bfc None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:26.331778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09a1c5-ffc1-4d5a-819f-96b092027bfc None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:26.333770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 131/247] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:26 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:26.334973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a1615-ae73-4262-ad77-db362d597144 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.335253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a1615-ae73-4262-ad77-db362d597144 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.335521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a1615-ae73-4262-ad77-db362d597144 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.336759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 132/248] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:26.340611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a1615-ae73-4262-ad77-db362d597144 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:26.342866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b037-8204-4fb6-b738-10e94072f802 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:26.381285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f4f7f-5470-4162-b276-413e135bfc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:26.381937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4f7f-5470-4162-b276-413e135bfc1d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.382250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4f7f-5470-4162-b276-413e135bfc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.382557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4f7f-5470-4162-b276-413e135bfc1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.393706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f4f7f-5470-4162-b276-413e135bfc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ab9f4f7f-5470-4162-b276-413e135bfc1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:26.398842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:26.399723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:26.401115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 117/249] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:55:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:26.406555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a95f1-3b22-4452-a351-2974337a45e6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.406840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a95f1-3b22-4452-a351-2974337a45e6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.407118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a95f1-3b22-4452-a351-2974337a45e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.426160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0b2a95f1-3b22-4452-a351-2974337a45e6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:26.427432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0b2a95f1-3b22-4452-a351-2974337a45e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:26.459869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a1615-ae73-4262-ad77-db362d597144 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:26.498189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6add6-1124-40ba-a297-58fdcb4954a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:26.499212 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6add6-1124-40ba-a297-58fdcb4954a4 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.499792 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6add6-1124-40ba-a297-58fdcb4954a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.500262 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6add6-1124-40ba-a297-58fdcb4954a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.501431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6add6-1124-40ba-a297-58fdcb4954a4 None admin] RBAC: Adding query filter params (role.id=771965b80b7e437fbedb3867eb4b6114, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a, user.id=6862b24f6c9644139152b0d795946b3a) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:26.501974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6add6-1124-40ba-a297-58fdcb4954a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:26.502302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 118/250] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:26.503413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a95f1-3b22-4452-a351-2974337a45e6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:26.504185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6add6-1124-40ba-a297-58fdcb4954a4 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:26.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 133/251] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:26 2022] GET /identity/v3/role_assignments?user.id=6862b24f6c9644139152b0d795946b3a&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=771965b80b7e437fbedb3867eb4b6114 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:26.529758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6add6-1124-40ba-a297-58fdcb4954a4 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:26.532056 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:26.546842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:26.651510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a95f1-3b22-4452-a351-2974337a45e6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:26.662169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6add6-1124-40ba-a297-58fdcb4954a4 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:26.694382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b066b-0893-4211-8858-3758bd0da7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:26.695054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b066b-0893-4211-8858-3758bd0da7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.695331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b066b-0893-4211-8858-3758bd0da7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.695600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b066b-0893-4211-8858-3758bd0da7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.696338 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b066b-0893-4211-8858-3758bd0da7b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:26.697162 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b066b-0893-4211-8858-3758bd0da7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:26.698614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b066b-0893-4211-8858-3758bd0da7b3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:26.709591 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 119/252] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:26.716433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71115e99-f642-4cd9-b052-7c9153294f54 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.716718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71115e99-f642-4cd9-b052-7c9153294f54 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.716987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71115e99-f642-4cd9-b052-7c9153294f54 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.718333 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 120/253] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:26.721301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71115e99-f642-4cd9-b052-7c9153294f54 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:26.742399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b8d56-ba19-4584-8b3c-5b4e275fdd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:26.743133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b8d56-ba19-4584-8b3c-5b4e275fdd59 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.743413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b8d56-ba19-4584-8b3c-5b4e275fdd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.743718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b8d56-ba19-4584-8b3c-5b4e275fdd59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.757864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b8d56-ba19-4584-8b3c-5b4e275fdd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-4d4b8d56-ba19-4584-8b3c-5b4e275fdd59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:26.764099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:26.764978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:26.765749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 134/254] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:26.770681 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca8ae5-2d52-41a7-b3ec-416a4d0afacb None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.771267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca8ae5-2d52-41a7-b3ec-416a4d0afacb None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.771746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca8ae5-2d52-41a7-b3ec-416a4d0afacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.790984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-39ca8ae5-2d52-41a7-b3ec-416a4d0afacb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:26.792484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-39ca8ae5-2d52-41a7-b3ec-416a4d0afacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:26.834486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:26.850632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71115e99-f642-4cd9-b052-7c9153294f54 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:26.889111 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42050880-3410-47b1-8b6d-624a3dc9a9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:26.889763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42050880-3410-47b1-8b6d-624a3dc9a9be None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:26.890034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42050880-3410-47b1-8b6d-624a3dc9a9be None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:26.890303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42050880-3410-47b1-8b6d-624a3dc9a9be None admin] PATH_INFO: `/v3/users/e3978719f3b748c399523e1f99621ba0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:26.891508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42050880-3410-47b1-8b6d-624a3dc9a9be None admin] RBAC: Authorizing `identity:get_user(user_id=e3978719f3b748c399523e1f99621ba0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:26.893405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42050880-3410-47b1-8b6d-624a3dc9a9be None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:26.895047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 121/255] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:26 2022] GET /identity/v3/users/e3978719f3b748c399523e1f99621ba0 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:26.901260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42050880-3410-47b1-8b6d-624a3dc9a9be None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:26.946467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:26.967896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 135/256] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:26.968766 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca8ae5-2d52-41a7-b3ec-416a4d0afacb None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:27.013853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42050880-3410-47b1-8b6d-624a3dc9a9be None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:27.058609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a7eb9-79f8-4103-89c4-925843fdf263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:27.059243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7eb9-79f8-4103-89c4-925843fdf263 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:27.066502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7eb9-79f8-4103-89c4-925843fdf263 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:27.066859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7eb9-79f8-4103-89c4-925843fdf263 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:27.067625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a7eb9-79f8-4103-89c4-925843fdf263 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:27.067939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a7eb9-79f8-4103-89c4-925843fdf263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:27.069330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a7eb9-79f8-4103-89c4-925843fdf263 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:27.086854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 122/257] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:27.087820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a7eb9-79f8-4103-89c4-925843fdf263 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:27.121293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:27.135914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca8ae5-2d52-41a7-b3ec-416a4d0afacb None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:27.188761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8661142-5a1c-4a72-81db-a9e77c32318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:27.189773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8661142-5a1c-4a72-81db-a9e77c32318b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:27.190251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8661142-5a1c-4a72-81db-a9e77c32318b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:27.190996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8661142-5a1c-4a72-81db-a9e77c32318b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:27.269831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:27.276910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8661142-5a1c-4a72-81db-a9e77c32318b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:27.278477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8661142-5a1c-4a72-81db-a9e77c32318b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:27.293913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a7eb9-79f8-4103-89c4-925843fdf263 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:27.331265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f180d1-7a80-4a87-a375-76a374fa527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:27.331839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f180d1-7a80-4a87-a375-76a374fa527e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:27.332121 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f180d1-7a80-4a87-a375-76a374fa527e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:27.332393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f180d1-7a80-4a87-a375-76a374fa527e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:27.343152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f180d1-7a80-4a87-a375-76a374fa527e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-57f180d1-7a80-4a87-a375-76a374fa527e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:27.348576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:27.349426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:27.350186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 123/258] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:27.350851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f180d1-7a80-4a87-a375-76a374fa527e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:27.434567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:27.459000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f180d1-7a80-4a87-a375-76a374fa527e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:27.495582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfcee8-bb1f-4480-974b-b5b576dbbe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:27.496263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfcee8-bb1f-4480-974b-b5b576dbbe04 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:27.496545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfcee8-bb1f-4480-974b-b5b576dbbe04 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:27.496873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfcee8-bb1f-4480-974b-b5b576dbbe04 None admin] PATH_INFO: `/v3/users/2b8810c240104da3b96b52693c5615ec` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:27.498095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfcee8-bb1f-4480-974b-b5b576dbbe04 None admin] RBAC: Authorizing `identity:get_user(user_id=2b8810c240104da3b96b52693c5615ec)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:27.499585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfcee8-bb1f-4480-974b-b5b576dbbe04 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:27.501267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 124/259] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:27 2022] GET /identity/v3/users/2b8810c240104da3b96b52693c5615ec => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:27.502025 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfcee8-bb1f-4480-974b-b5b576dbbe04 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:27.542540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 136/260] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:27.543702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8661142-5a1c-4a72-81db-a9e77c32318b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:27.610022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfcee8-bb1f-4480-974b-b5b576dbbe04 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:27.646158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7e7b0-93ed-40c1-91ef-78402a90c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:27.646822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7e7b0-93ed-40c1-91ef-78402a90c7fd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:27.647104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7e7b0-93ed-40c1-91ef-78402a90c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:27.647384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7e7b0-93ed-40c1-91ef-78402a90c7fd None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:27.648104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7e7b0-93ed-40c1-91ef-78402a90c7fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:27.648412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7e7b0-93ed-40c1-91ef-78402a90c7fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:27.649817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7e7b0-93ed-40c1-91ef-78402a90c7fd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:27.658751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 125/261] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:27.659582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7e7b0-93ed-40c1-91ef-78402a90c7fd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:27.670652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:27.710865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:27.724903 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8661142-5a1c-4a72-81db-a9e77c32318b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:27.785393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f2e5-e9e1-42b2-ac46-e5a39de18ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:27.787632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7e7b0-93ed-40c1-91ef-78402a90c7fd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:27.788467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f2e5-e9e1-42b2-ac46-e5a39de18ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:27.788935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f2e5-e9e1-42b2-ac46-e5a39de18ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:27.789401 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f2e5-e9e1-42b2-ac46-e5a39de18ec7 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:27.792902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0f2e5-e9e1-42b2-ac46-e5a39de18ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:27.794598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0f2e5-e9e1-42b2-ac46-e5a39de18ec7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:27.798024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 137/262] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:27 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:27.807653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f2e5-e9e1-42b2-ac46-e5a39de18ec7 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:27.871605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6c5c0-a5f7-4f3e-b393-43372903ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:27.877609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6c5c0-a5f7-4f3e-b393-43372903ec00 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:27.878801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6c5c0-a5f7-4f3e-b393-43372903ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:27.880290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6c5c0-a5f7-4f3e-b393-43372903ec00 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:27.883705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6c5c0-a5f7-4f3e-b393-43372903ec00 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:27.885403 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6c5c0-a5f7-4f3e-b393-43372903ec00 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:27.888217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 126/263] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:27 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:27.893838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6c5c0-a5f7-4f3e-b393-43372903ec00 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:27.986820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:28.026800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6c5c0-a5f7-4f3e-b393-43372903ec00 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:28.040984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f2e5-e9e1-42b2-ac46-e5a39de18ec7 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:28.070003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae3fb1-ed86-4544-9a88-04af70e120bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:28.072593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae3fb1-ed86-4544-9a88-04af70e120bc None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:28.073210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae3fb1-ed86-4544-9a88-04af70e120bc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:28.075243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae3fb1-ed86-4544-9a88-04af70e120bc None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/users/2b8810c240104da3b96b52693c5615ec/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:28.079222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae3fb1-ed86-4544-9a88-04af70e120bc None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6ca290b26543f7b6f2d6086cfa623a, user_id=2b8810c240104da3b96b52693c5615ec, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:28.080919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae3fb1-ed86-4544-9a88-04af70e120bc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:28.100590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 127/264] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:55:27 2022] PUT /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/users/2b8810c240104da3b96b52693c5615ec/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:28.101741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae3fb1-ed86-4544-9a88-04af70e120bc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:28.127494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb44f-1637-4d7d-b7a6-0f09010fbc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:28.129396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb44f-1637-4d7d-b7a6-0f09010fbc29 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:28.130882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb44f-1637-4d7d-b7a6-0f09010fbc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:28.131336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb44f-1637-4d7d-b7a6-0f09010fbc29 None admin] PATH_INFO: `/v3/users/e3978719f3b748c399523e1f99621ba0` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:28.133468 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acb44f-1637-4d7d-b7a6-0f09010fbc29 None admin] RBAC: Authorizing `identity:get_user(user_id=e3978719f3b748c399523e1f99621ba0)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:28.136649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acb44f-1637-4d7d-b7a6-0f09010fbc29 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:28.141760 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 138/265] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:27 2022] GET /identity/v3/users/e3978719f3b748c399523e1f99621ba0 => generated 283 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:28.147313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb44f-1637-4d7d-b7a6-0f09010fbc29 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:28.222584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:28.308733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae3fb1-ed86-4544-9a88-04af70e120bc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:28.353504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb44f-1637-4d7d-b7a6-0f09010fbc29 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:28.369865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5b755-f5e1-4101-9c65-1e872a4ad9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:28.370537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5b755-f5e1-4101-9c65-1e872a4ad9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:28.370816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5b755-f5e1-4101-9c65-1e872a4ad9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:28.371087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5b755-f5e1-4101-9c65-1e872a4ad9b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:28.371885 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5b755-f5e1-4101-9c65-1e872a4ad9b5 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a, user.id=e3978719f3b748c399523e1f99621ba0) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:28.372194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5b755-f5e1-4101-9c65-1e872a4ad9b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:28.373724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5b755-f5e1-4101-9c65-1e872a4ad9b5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:28.375941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:28.387224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 128/266] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:28 2022] GET /identity/v3/role_assignments?user.id=e3978719f3b748c399523e1f99621ba0&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:28.398637 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703d6a1-2c3a-4f3a-8a14-e357fad2ec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:28.399701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703d6a1-2c3a-4f3a-8a14-e357fad2ec54 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:28.400243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703d6a1-2c3a-4f3a-8a14-e357fad2ec54 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:28.400739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703d6a1-2c3a-4f3a-8a14-e357fad2ec54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:28.477395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703d6a1-2c3a-4f3a-8a14-e357fad2ec54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:28.479845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703d6a1-2c3a-4f3a-8a14-e357fad2ec54 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:28.517206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:28.553743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed0e1-2b50-48fe-8015-7f6346771ee0 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:28.554054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed0e1-2b50-48fe-8015-7f6346771ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:28.554296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed0e1-2b50-48fe-8015-7f6346771ee0 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:28.555956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 129/267] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:28.562775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4504ec-2ca2-49b2-8563-8eb97d09b47d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:28.563080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4504ec-2ca2-49b2-8563-8eb97d09b47d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:28.563322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4504ec-2ca2-49b2-8563-8eb97d09b47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:28.594240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 139/268] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 01:55:28.604379 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703d6a1-2c3a-4f3a-8a14-e357fad2ec54 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:28.611343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-df4504ec-2ca2-49b2-8563-8eb97d09b47d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:28.612582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-df4504ec-2ca2-49b2-8563-8eb97d09b47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:28.747626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 130/269] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:28.772137 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4504ec-2ca2-49b2-8563-8eb97d09b47d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:28.786112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703d6a1-2c3a-4f3a-8a14-e357fad2ec54 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:28.851172 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb129f4-523c-4e41-96b4-ac6961a98d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:28.851819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb129f4-523c-4e41-96b4-ac6961a98d7b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:28.852096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb129f4-523c-4e41-96b4-ac6961a98d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:28.852367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb129f4-523c-4e41-96b4-ac6961a98d7b None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:28.855254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb129f4-523c-4e41-96b4-ac6961a98d7b None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:28.857151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb129f4-523c-4e41-96b4-ac6961a98d7b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:28.859023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 140/270] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:28 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:28.862082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae6e4-9f96-4658-b1a5-0075600dee39 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:28.862082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae6e4-9f96-4658-b1a5-0075600dee39 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:28.862082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae6e4-9f96-4658-b1a5-0075600dee39 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:28.862313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 141/271] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:28.869227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ae6e4-9f96-4658-b1a5-0075600dee39 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:28.872083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:28.897893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4504ec-2ca2-49b2-8563-8eb97d09b47d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:28.942799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:28.951713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0163043-1dbc-4873-9e8c-5bdbab4a28ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:28.952715 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0163043-1dbc-4873-9e8c-5bdbab4a28ad None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:28.953270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0163043-1dbc-4873-9e8c-5bdbab4a28ad None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:28.953733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0163043-1dbc-4873-9e8c-5bdbab4a28ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:28.968502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0163043-1dbc-4873-9e8c-5bdbab4a28ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d0163043-1dbc-4873-9e8c-5bdbab4a28ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:28.976988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:28.977913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:28.979106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 131/272] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:28.980796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eeeba-dfda-4478-aef9-0c4235a88cbf None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:28.981081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eeeba-dfda-4478-aef9-0c4235a88cbf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:28.981353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eeeba-dfda-4478-aef9-0c4235a88cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:29.004589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-575eeeba-dfda-4478-aef9-0c4235a88cbf None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:29.006297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ae6e4-9f96-4658-b1a5-0075600dee39 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:29.006869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-575eeeba-dfda-4478-aef9-0c4235a88cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:29.050553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b2a97-63b0-468d-ae54-dfc945fa61ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:29.051239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b2a97-63b0-468d-ae54-dfc945fa61ba None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:29.051448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b2a97-63b0-468d-ae54-dfc945fa61ba None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:29.051728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b2a97-63b0-468d-ae54-dfc945fa61ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:29.052518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b2a97-63b0-468d-ae54-dfc945fa61ba None admin] RBAC: Adding query filter params (role.id=42afac3d251b45ed822081a66ad20d6d, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a, user.id=e3978719f3b748c399523e1f99621ba0) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:29.052829 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b2a97-63b0-468d-ae54-dfc945fa61ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:29.054700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b2a97-63b0-468d-ae54-dfc945fa61ba None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:29.063034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 142/273] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:28 2022] GET /identity/v3/role_assignments?user.id=e3978719f3b748c399523e1f99621ba0&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=42afac3d251b45ed822081a66ad20d6d => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:29.063837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b2a97-63b0-468d-ae54-dfc945fa61ba None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:29.104239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 132/274] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:29.139985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eeeba-dfda-4478-aef9-0c4235a88cbf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:29.197035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:29.242324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b2a97-63b0-468d-ae54-dfc945fa61ba None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:29.280068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8796419-d40e-4cf6-8bbe-ea951c40615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:29.280613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8796419-d40e-4cf6-8bbe-ea951c40615b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:29.280891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8796419-d40e-4cf6-8bbe-ea951c40615b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:29.281162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8796419-d40e-4cf6-8bbe-ea951c40615b None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:29.281884 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8796419-d40e-4cf6-8bbe-ea951c40615b None admin] RBAC: Adding query filter params (name=member) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:29.282185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8796419-d40e-4cf6-8bbe-ea951c40615b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:29.283597 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8796419-d40e-4cf6-8bbe-ea951c40615b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:29.293004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 143/275] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:29.298290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8796419-d40e-4cf6-8bbe-ea951c40615b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:29.316205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eeeba-dfda-4478-aef9-0c4235a88cbf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:29.336645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:29.358087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8cada-316a-4233-a28b-88f1080437a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:29.359175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8cada-316a-4233-a28b-88f1080437a8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:29.359625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8cada-316a-4233-a28b-88f1080437a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:29.360044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8cada-316a-4233-a28b-88f1080437a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:29.362215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8cada-316a-4233-a28b-88f1080437a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:29.364131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8cada-316a-4233-a28b-88f1080437a8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:29.365984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 133/276] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:29.375370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8cada-316a-4233-a28b-88f1080437a8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:29.415504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8796419-d40e-4cf6-8bbe-ea951c40615b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:29.450772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:29.459508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c49e8b-e811-47a7-b3e0-8fb5b4bace26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:29.460148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49e8b-e811-47a7-b3e0-8fb5b4bace26 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:29.460424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49e8b-e811-47a7-b3e0-8fb5b4bace26 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:29.460698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49e8b-e811-47a7-b3e0-8fb5b4bace26 None admin] PATH_INFO: `/v3/users/53b6eba8181a4d6dac1bba7458cbe44d` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:29.475442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c49e8b-e811-47a7-b3e0-8fb5b4bace26 None admin] RBAC: Authorizing `identity:get_user(user_id=53b6eba8181a4d6dac1bba7458cbe44d)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:29.476915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c49e8b-e811-47a7-b3e0-8fb5b4bace26 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:29.478685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 144/277] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:29 2022] GET /identity/v3/users/53b6eba8181a4d6dac1bba7458cbe44d => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:29.479860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd151e9-eea6-4784-b674-726f8c6d8d18 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:29.480200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd151e9-eea6-4784-b674-726f8c6d8d18 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:29.480477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd151e9-eea6-4784-b674-726f8c6d8d18 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:29.481709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 145/278] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:29.486352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd151e9-eea6-4784-b674-726f8c6d8d18 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:29.504441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8cada-316a-4233-a28b-88f1080437a8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:29.544981 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e1028-17e4-405f-8ce8-9dd142aa3124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:29.545529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e1028-17e4-405f-8ce8-9dd142aa3124 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:29.545808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e1028-17e4-405f-8ce8-9dd142aa3124 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:29.546082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e1028-17e4-405f-8ce8-9dd142aa3124 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:29.546804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e1028-17e4-405f-8ce8-9dd142aa3124 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:29.548233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e1028-17e4-405f-8ce8-9dd142aa3124 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:29.578307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 134/279] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:29 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:29.578307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71d3d-2a46-4db2-90a3-a189e76b446c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:29.578307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71d3d-2a46-4db2-90a3-a189e76b446c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:29.578307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71d3d-2a46-4db2-90a3-a189e76b446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:29.594278 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3dc71d3d-2a46-4db2-90a3-a189e76b446c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:29.595919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3dc71d3d-2a46-4db2-90a3-a189e76b446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:29.621676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd151e9-eea6-4784-b674-726f8c6d8d18 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:29.647320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:29.669551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543fbc1-c0c9-4cb2-b61f-39ff84a033ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:29.670461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543fbc1-c0c9-4cb2-b61f-39ff84a033ea None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:29.671025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543fbc1-c0c9-4cb2-b61f-39ff84a033ea None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:29.671499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543fbc1-c0c9-4cb2-b61f-39ff84a033ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:29.672561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543fbc1-c0c9-4cb2-b61f-39ff84a033ea None admin] RBAC: Adding query filter params (role.id=55fc2032ca914d2fb1ec5cbd52f60e54, user.id=53b6eba8181a4d6dac1bba7458cbe44d, scope.system=all) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:29.673053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543fbc1-c0c9-4cb2-b61f-39ff84a033ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:29.674810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543fbc1-c0c9-4cb2-b61f-39ff84a033ea None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:29.682222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 146/280] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Jul 28 01:55:29 2022] GET /identity/v3/role_assignments?user.id=53b6eba8181a4d6dac1bba7458cbe44d&scope.system=all&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:29.692696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 135/281] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:29.715496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543fbc1-c0c9-4cb2-b61f-39ff84a033ea None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:29.774132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:29.831080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543fbc1-c0c9-4cb2-b61f-39ff84a033ea None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:29.870935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9550e-2914-4fb5-aee5-d4c82b40aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:29.871581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9550e-2914-4fb5-aee5-d4c82b40aeca None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:29.871859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9550e-2914-4fb5-aee5-d4c82b40aeca None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:29.872134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9550e-2914-4fb5-aee5-d4c82b40aeca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:29.887385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9550e-2914-4fb5-aee5-d4c82b40aeca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-2cf9550e-2914-4fb5-aee5-d4c82b40aeca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:29.892436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:29.893299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:29.894100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 147/282] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:29.900282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc71d3d-2a46-4db2-90a3-a189e76b446c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:30.030107 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc71d3d-2a46-4db2-90a3-a189e76b446c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:30.068058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34fe0d-dbb6-4111-93c8-cbcbbf8d53f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:30.068686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34fe0d-dbb6-4111-93c8-cbcbbf8d53f2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:30.068970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34fe0d-dbb6-4111-93c8-cbcbbf8d53f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:30.069240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34fe0d-dbb6-4111-93c8-cbcbbf8d53f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:30.069954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34fe0d-dbb6-4111-93c8-cbcbbf8d53f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:30.070255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34fe0d-dbb6-4111-93c8-cbcbbf8d53f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:30.071710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34fe0d-dbb6-4111-93c8-cbcbbf8d53f2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:30.080426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 136/283] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:30.086263 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9550e-2914-4fb5-aee5-d4c82b40aeca None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:30.223767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9550e-2914-4fb5-aee5-d4c82b40aeca None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:30.239990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:30.276536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78ec7d-9d68-43b0-84e6-140ef6b04577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:30.277184 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78ec7d-9d68-43b0-84e6-140ef6b04577 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:30.277463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78ec7d-9d68-43b0-84e6-140ef6b04577 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:30.277738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78ec7d-9d68-43b0-84e6-140ef6b04577 None admin] PATH_INFO: `/v3/users/6862b24f6c9644139152b0d795946b3a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:30.278959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78ec7d-9d68-43b0-84e6-140ef6b04577 None admin] RBAC: Authorizing `identity:get_user(user_id=6862b24f6c9644139152b0d795946b3a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:30.280421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78ec7d-9d68-43b0-84e6-140ef6b04577 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:30.282356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 148/284] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:30 2022] GET /identity/v3/users/6862b24f6c9644139152b0d795946b3a => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:30.287802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34fe0d-dbb6-4111-93c8-cbcbbf8d53f2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:30.337959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:30.451555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34fe0d-dbb6-4111-93c8-cbcbbf8d53f2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:30.508623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cc55b-9b5c-446f-bc2c-6d65c6ae786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:30.510196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cc55b-9b5c-446f-bc2c-6d65c6ae786c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:30.510695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cc55b-9b5c-446f-bc2c-6d65c6ae786c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:30.511158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cc55b-9b5c-446f-bc2c-6d65c6ae786c None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:30.512585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cc55b-9b5c-446f-bc2c-6d65c6ae786c None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:30.522468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cc55b-9b5c-446f-bc2c-6d65c6ae786c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:30.524636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 137/285] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:30 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:30.531483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78ec7d-9d68-43b0-84e6-140ef6b04577 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:30.609037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32347059-7bbb-43fa-bcbb-3e79ab1b9384 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:30.609970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32347059-7bbb-43fa-bcbb-3e79ab1b9384 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:30.610472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32347059-7bbb-43fa-bcbb-3e79ab1b9384 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:30.612909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 138/286] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:30.619586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa71029-19f4-47e0-89b2-90583d1f3190 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:30.620077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa71029-19f4-47e0-89b2-90583d1f3190 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:30.620544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa71029-19f4-47e0-89b2-90583d1f3190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:30.646417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-faa71029-19f4-47e0-89b2-90583d1f3190 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:30.647984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-faa71029-19f4-47e0-89b2-90583d1f3190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:30.699218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78ec7d-9d68-43b0-84e6-140ef6b04577 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:30.761517 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 139/287] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:30.763346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb28b9-997c-4082-9a26-632b3d0912f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:30.764240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb28b9-997c-4082-9a26-632b3d0912f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:30.764732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb28b9-997c-4082-9a26-632b3d0912f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:30.765200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb28b9-997c-4082-9a26-632b3d0912f4 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/users/6862b24f6c9644139152b0d795946b3a/roles/771965b80b7e437fbedb3867eb4b6114` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:30.767365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb28b9-997c-4082-9a26-632b3d0912f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6ca290b26543f7b6f2d6086cfa623a, user_id=6862b24f6c9644139152b0d795946b3a, role_id=771965b80b7e437fbedb3867eb4b6114)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:30.769007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb28b9-997c-4082-9a26-632b3d0912f4 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:30.791324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 149/288] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:55:30 2022] PUT /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/users/6862b24f6c9644139152b0d795946b3a/roles/771965b80b7e437fbedb3867eb4b6114 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:30.795544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa71029-19f4-47e0-89b2-90583d1f3190 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:30.830540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:30.926933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa71029-19f4-47e0-89b2-90583d1f3190 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:30.974576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88b85a-f613-4f66-aa2e-ea8797e44700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:30.975631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88b85a-f613-4f66-aa2e-ea8797e44700 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:30.976100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88b85a-f613-4f66-aa2e-ea8797e44700 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:30.976558 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88b85a-f613-4f66-aa2e-ea8797e44700 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:30.987834 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88b85a-f613-4f66-aa2e-ea8797e44700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7e88b85a-f613-4f66-aa2e-ea8797e44700 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:30.993191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:30.994907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:30.995692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:30.998243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 140/289] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:31.004336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb28b9-997c-4082-9a26-632b3d0912f4 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:31.047419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:31.114471 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb28b9-997c-4082-9a26-632b3d0912f4 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:31.152152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45339c17-c955-432e-943c-605eb02a5509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:31.152691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339c17-c955-432e-943c-605eb02a5509 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:31.152968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339c17-c955-432e-943c-605eb02a5509 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:31.153238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339c17-c955-432e-943c-605eb02a5509 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:31.153962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339c17-c955-432e-943c-605eb02a5509 None admin] RBAC: Adding query filter params (name=member) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:31.154263 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339c17-c955-432e-943c-605eb02a5509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:31.155668 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339c17-c955-432e-943c-605eb02a5509 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:31.164993 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 150/290] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:31.171086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88b85a-f613-4f66-aa2e-ea8797e44700 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:31.268360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:31.277616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88b85a-f613-4f66-aa2e-ea8797e44700 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:31.320625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b8f91-c449-4007-bfee-01bc20981fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:31.321266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b8f91-c449-4007-bfee-01bc20981fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:31.321538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b8f91-c449-4007-bfee-01bc20981fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:31.321838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b8f91-c449-4007-bfee-01bc20981fa5 None admin] PATH_INFO: `/v3/users/2b8810c240104da3b96b52693c5615ec` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:31.323030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b8f91-c449-4007-bfee-01bc20981fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=2b8810c240104da3b96b52693c5615ec)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:31.324473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b8f91-c449-4007-bfee-01bc20981fa5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:31.326068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 141/291] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:31 2022] GET /identity/v3/users/2b8810c240104da3b96b52693c5615ec => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:31.331515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45339c17-c955-432e-943c-605eb02a5509 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:31.443204 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45339c17-c955-432e-943c-605eb02a5509 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:31.446771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:31.480992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34584f5f-7fe0-4158-b7eb-385100350d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:31.481613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584f5f-7fe0-4158-b7eb-385100350d23 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:31.481893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584f5f-7fe0-4158-b7eb-385100350d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:31.482164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584f5f-7fe0-4158-b7eb-385100350d23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:31.551824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34584f5f-7fe0-4158-b7eb-385100350d23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:31.553297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34584f5f-7fe0-4158-b7eb-385100350d23 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:31.655116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 151/292] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 01:55:31.655807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:31.660795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b8f91-c449-4007-bfee-01bc20981fa5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:31.786886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b8f91-c449-4007-bfee-01bc20981fa5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:31.836098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4fc7e-32a8-4d0e-94be-605a3c6f6b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:31.836748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4fc7e-32a8-4d0e-94be-605a3c6f6b14 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:31.837085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4fc7e-32a8-4d0e-94be-605a3c6f6b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:31.837999 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4fc7e-32a8-4d0e-94be-605a3c6f6b14 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:31.839236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4fc7e-32a8-4d0e-94be-605a3c6f6b14 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:31.840689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4fc7e-32a8-4d0e-94be-605a3c6f6b14 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:31.842709 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 142/293] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:31 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:31.850777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34584f5f-7fe0-4158-b7eb-385100350d23 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:31.963552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34584f5f-7fe0-4158-b7eb-385100350d23 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:31.998836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af8e47-0164-4e86-9237-0f7b97d6fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:31.999446 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af8e47-0164-4e86-9237-0f7b97d6fe03 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:31.999768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af8e47-0164-4e86-9237-0f7b97d6fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.000040 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af8e47-0164-4e86-9237-0f7b97d6fe03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.000822 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af8e47-0164-4e86-9237-0f7b97d6fe03 None admin] RBAC: Adding query filter params (role.id=55fc2032ca914d2fb1ec5cbd52f60e54, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a, user.id=2b8810c240104da3b96b52693c5615ec) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:32.001127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af8e47-0164-4e86-9237-0f7b97d6fe03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:32.002591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af8e47-0164-4e86-9237-0f7b97d6fe03 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:32.008532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 152/294] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:31 2022] GET /identity/v3/role_assignments?user.id=2b8810c240104da3b96b52693c5615ec&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:32.067056 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ba037-0a5f-4453-aa90-a2cc4516f79a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.067386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ba037-0a5f-4453-aa90-a2cc4516f79a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.067604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ba037-0a5f-4453-aa90-a2cc4516f79a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.068961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 143/295] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:32.075234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed672f6-ef49-4dfe-a35d-b5ab3ac88dc1 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.075518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed672f6-ef49-4dfe-a35d-b5ab3ac88dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.075786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed672f6-ef49-4dfe-a35d-b5ab3ac88dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.104302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-2ed672f6-ef49-4dfe-a35d-b5ab3ac88dc1 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:32.105537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2ed672f6-ef49-4dfe-a35d-b5ab3ac88dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:32.197388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:32.210747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 153/296] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:32.230423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ba037-0a5f-4453-aa90-a2cc4516f79a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:32.240667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52437-33c0-476e-8bbd-843416558466 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.240943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52437-33c0-476e-8bbd-843416558466 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.241217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52437-33c0-476e-8bbd-843416558466 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.242851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 154/297] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:32.249040 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdea10-338e-4a6a-8d51-e552fa1eab20 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.249325 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdea10-338e-4a6a-8d51-e552fa1eab20 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.249612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdea10-338e-4a6a-8d51-e552fa1eab20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.267475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:32.273395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e1cdea10-338e-4a6a-8d51-e552fa1eab20 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:32.274668 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e1cdea10-338e-4a6a-8d51-e552fa1eab20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:32.351955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 155/298] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:32.360156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ba037-0a5f-4453-aa90-a2cc4516f79a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:32.381498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdea10-338e-4a6a-8d51-e552fa1eab20 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:32.403572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eaa05-a4e3-44ec-aac9-44b1b393a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:32.404222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eaa05-a4e3-44ec-aac9-44b1b393a01c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.404504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eaa05-a4e3-44ec-aac9-44b1b393a01c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.404770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eaa05-a4e3-44ec-aac9-44b1b393a01c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.418733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eaa05-a4e3-44ec-aac9-44b1b393a01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5b3eaa05-a4e3-44ec-aac9-44b1b393a01c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:32.424711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:32.425547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:32.426738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 144/299] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:32.432181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eaa05-a4e3-44ec-aac9-44b1b393a01c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:32.505296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdea10-338e-4a6a-8d51-e552fa1eab20 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:32.531754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:32.536856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:32.543272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf163a9-c1d5-47ec-9039-18d64914d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:32.543910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf163a9-c1d5-47ec-9039-18d64914d5be None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.544190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf163a9-c1d5-47ec-9039-18d64914d5be None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.544458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf163a9-c1d5-47ec-9039-18d64914d5be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.550481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eaa05-a4e3-44ec-aac9-44b1b393a01c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:32.556648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf163a9-c1d5-47ec-9039-18d64914d5be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-2cf163a9-c1d5-47ec-9039-18d64914d5be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:32.562816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:32.563690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:32.565156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 156/300] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:32.567065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ed455-8e69-4e13-aa53-17c323ce3ae2 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.567065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ed455-8e69-4e13-aa53-17c323ce3ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.567065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ed455-8e69-4e13-aa53-17c323ce3ae2 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.568647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 157/301] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:32.570480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ed455-8e69-4e13-aa53-17c323ce3ae2 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:32.594423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9b58d-fb83-4f5c-b8ad-cab45efd18bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:32.595099 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9b58d-fb83-4f5c-b8ad-cab45efd18bc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.595386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9b58d-fb83-4f5c-b8ad-cab45efd18bc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.595652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9b58d-fb83-4f5c-b8ad-cab45efd18bc None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.596392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9b58d-fb83-4f5c-b8ad-cab45efd18bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:32.596696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9b58d-fb83-4f5c-b8ad-cab45efd18bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:32.598109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9b58d-fb83-4f5c-b8ad-cab45efd18bc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:32.612406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 145/302] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:32.612406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb9841-893b-421e-95fa-f1dd41360f2a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.612406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb9841-893b-421e-95fa-f1dd41360f2a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.612406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb9841-893b-421e-95fa-f1dd41360f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.627999 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a8eb9841-893b-421e-95fa-f1dd41360f2a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:32.629304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a8eb9841-893b-421e-95fa-f1dd41360f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:32.686290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ed455-8e69-4e13-aa53-17c323ce3ae2 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:32.697277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 146/303] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:32.706638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb9841-893b-421e-95fa-f1dd41360f2a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:32.735619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230d901-8d7b-464e-b929-49366de70b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:32.736233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230d901-8d7b-464e-b929-49366de70b0c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.736510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230d901-8d7b-464e-b929-49366de70b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.736781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230d901-8d7b-464e-b929-49366de70b0c None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.737913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230d901-8d7b-464e-b929-49366de70b0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:32.738231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230d901-8d7b-464e-b929-49366de70b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:32.740009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230d901-8d7b-464e-b929-49366de70b0c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:32.749700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 158/304] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:32.750322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230d901-8d7b-464e-b929-49366de70b0c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:32.788707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:32.809948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:32.816576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb9841-893b-421e-95fa-f1dd41360f2a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:32.852355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edf51e-d938-4e23-bcfa-0915fdb5e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:32.853506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edf51e-d938-4e23-bcfa-0915fdb5e70b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.853784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edf51e-d938-4e23-bcfa-0915fdb5e70b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.854054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edf51e-d938-4e23-bcfa-0915fdb5e70b None admin] PATH_INFO: `/v3/users/53b6eba8181a4d6dac1bba7458cbe44d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.855259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edf51e-d938-4e23-bcfa-0915fdb5e70b None admin] RBAC: Authorizing `identity:get_user(user_id=53b6eba8181a4d6dac1bba7458cbe44d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:32.856713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edf51e-d938-4e23-bcfa-0915fdb5e70b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:32.858327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 147/305] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:32 2022] GET /identity/v3/users/53b6eba8181a4d6dac1bba7458cbe44d => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:32.858327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edf51e-d938-4e23-bcfa-0915fdb5e70b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:32.877522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230d901-8d7b-464e-b929-49366de70b0c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:32.912138 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ad0aa-d9f8-44a8-9a8e-9cb52b31605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:32.912769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ad0aa-d9f8-44a8-9a8e-9cb52b31605f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:32.913052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ad0aa-d9f8-44a8-9a8e-9cb52b31605f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:32.913323 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ad0aa-d9f8-44a8-9a8e-9cb52b31605f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:32.914508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ad0aa-d9f8-44a8-9a8e-9cb52b31605f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:32.916505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ad0aa-d9f8-44a8-9a8e-9cb52b31605f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:32.923192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 159/306] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:32.923192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ad0aa-d9f8-44a8-9a8e-9cb52b31605f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:32.976518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edf51e-d938-4e23-bcfa-0915fdb5e70b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:33.013118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627a593-c84e-433b-9d3b-83809b853642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:33.013759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a593-c84e-433b-9d3b-83809b853642 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:33.014052 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a593-c84e-433b-9d3b-83809b853642 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:33.014315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a593-c84e-433b-9d3b-83809b853642 None admin] PATH_INFO: `/v3/users/8346176b44ff43aaafcab320e9b1728d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:33.026422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ad0aa-d9f8-44a8-9a8e-9cb52b31605f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:33.029497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627a593-c84e-433b-9d3b-83809b853642 None admin] RBAC: Authorizing `identity:get_user(user_id=8346176b44ff43aaafcab320e9b1728d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:33.031269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627a593-c84e-433b-9d3b-83809b853642 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:33.032937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 148/307] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:32 2022] GET /identity/v3/users/8346176b44ff43aaafcab320e9b1728d => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:33.033679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627a593-c84e-433b-9d3b-83809b853642 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:33.046717 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:33.049137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:33.072109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5182db8-f3d8-4a44-b65f-158adf917759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:33.072770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5182db8-f3d8-4a44-b65f-158adf917759 None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:33.073051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5182db8-f3d8-4a44-b65f-158adf917759 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:33.073324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5182db8-f3d8-4a44-b65f-158adf917759 None admin] PATH_INFO: `/v3/system/users/53b6eba8181a4d6dac1bba7458cbe44d/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:33.075259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5182db8-f3d8-4a44-b65f-158adf917759 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=53b6eba8181a4d6dac1bba7458cbe44d, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:33.076223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5182db8-f3d8-4a44-b65f-158adf917759 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:33.085461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 160/308] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Jul 28 01:55:32 2022] PUT /identity/v3/system/users/53b6eba8181a4d6dac1bba7458cbe44d/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:33.086342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5182db8-f3d8-4a44-b65f-158adf917759 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:33.182781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627a593-c84e-433b-9d3b-83809b853642 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:33.203761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5182db8-f3d8-4a44-b65f-158adf917759 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:33.236846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629de32-97c7-43d4-b3e1-9ec81fb91ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:33.237963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629de32-97c7-43d4-b3e1-9ec81fb91ad9 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:33.237963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629de32-97c7-43d4-b3e1-9ec81fb91ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:33.238125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629de32-97c7-43d4-b3e1-9ec81fb91ad9 None admin] PATH_INFO: `/v3/groups` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:33.239266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629de32-97c7-43d4-b3e1-9ec81fb91ad9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:33.240192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629de32-97c7-43d4-b3e1-9ec81fb91ad9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:33.250166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d7407-7553-4e78-893c-a218a4a4221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:33.250874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d7407-7553-4e78-893c-a218a4a4221c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:33.251234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d7407-7553-4e78-893c-a218a4a4221c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:33.251506 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d7407-7553-4e78-893c-a218a4a4221c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:33.252441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d7407-7553-4e78-893c-a218a4a4221c None admin] RBAC: Adding query filter params (role.id=771965b80b7e437fbedb3867eb4b6114, user.id=8346176b44ff43aaafcab320e9b1728d, scope.system=all) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:33.252788 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d7407-7553-4e78-893c-a218a4a4221c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:33.254334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d7407-7553-4e78-893c-a218a4a4221c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:33.265592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 149/309] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Jul 28 01:55:33 2022] POST /identity/v3/groups => generated 229 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:33.265783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 161/310] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Jul 28 01:55:33 2022] GET /identity/v3/role_assignments?user.id=8346176b44ff43aaafcab320e9b1728d&scope.system=all&role.id=771965b80b7e437fbedb3867eb4b6114 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:33.497681 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a209-26c3-47d8-964b-12e8d9e658c6 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:33.498018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a209-26c3-47d8-964b-12e8d9e658c6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:33.498214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a209-26c3-47d8-964b-12e8d9e658c6 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:33.499818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 150/311] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:33.505063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18d6cf-bd08-41a9-a43a-ab316c7f73cb None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:33.505356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18d6cf-bd08-41a9-a43a-ab316c7f73cb None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:33.505635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18d6cf-bd08-41a9-a43a-ab316c7f73cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:33.530290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ad18d6cf-bd08-41a9-a43a-ab316c7f73cb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:33.531531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ad18d6cf-bd08-41a9-a43a-ab316c7f73cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:33.568519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:33.607012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 162/312] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:33.629617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7a209-26c3-47d8-964b-12e8d9e658c6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:33.701597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:33.738543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7a209-26c3-47d8-964b-12e8d9e658c6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:33.775274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25077f43-1dfb-4e49-a8ba-78d11e842929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:33.775857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25077f43-1dfb-4e49-a8ba-78d11e842929 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:33.776138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25077f43-1dfb-4e49-a8ba-78d11e842929 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:33.776413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25077f43-1dfb-4e49-a8ba-78d11e842929 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:33.788855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25077f43-1dfb-4e49-a8ba-78d11e842929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-25077f43-1dfb-4e49-a8ba-78d11e842929 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:33.794351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:33.795222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:33.796010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 151/313] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:33.801633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18d6cf-bd08-41a9-a43a-ab316c7f73cb None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:33.908903 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18d6cf-bd08-41a9-a43a-ab316c7f73cb None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:33.944635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d037a7-d437-4b02-8067-9b882fac2dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:33.945256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d037a7-d437-4b02-8067-9b882fac2dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:33.945537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d037a7-d437-4b02-8067-9b882fac2dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:33.945813 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d037a7-d437-4b02-8067-9b882fac2dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:33.946615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d037a7-d437-4b02-8067-9b882fac2dd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:33.947434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d037a7-d437-4b02-8067-9b882fac2dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:33.948821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d037a7-d437-4b02-8067-9b882fac2dd3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:33.957576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 163/314] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:33.963126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25077f43-1dfb-4e49-a8ba-78d11e842929 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:34.074591 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25077f43-1dfb-4e49-a8ba-78d11e842929 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:34.101095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:34.111159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3daccf-8c5c-4f3e-b6c9-08916d98871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:34.112026 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3daccf-8c5c-4f3e-b6c9-08916d98871d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:34.112482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3daccf-8c5c-4f3e-b6c9-08916d98871d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:34.112960 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3daccf-8c5c-4f3e-b6c9-08916d98871d None admin] PATH_INFO: `/v3/users/6862b24f6c9644139152b0d795946b3a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:34.114299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3daccf-8c5c-4f3e-b6c9-08916d98871d None admin] RBAC: Authorizing `identity:get_user(user_id=6862b24f6c9644139152b0d795946b3a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:34.115955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3daccf-8c5c-4f3e-b6c9-08916d98871d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:34.118081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 152/315] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:33 2022] GET /identity/v3/users/6862b24f6c9644139152b0d795946b3a => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:34.124261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d037a7-d437-4b02-8067-9b882fac2dd3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:34.159626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:34.235434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d037a7-d437-4b02-8067-9b882fac2dd3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:34.269733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d433d8-2b9e-4779-8199-ea4302e523df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:34.270339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d433d8-2b9e-4779-8199-ea4302e523df None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:34.270642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d433d8-2b9e-4779-8199-ea4302e523df None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:34.270909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d433d8-2b9e-4779-8199-ea4302e523df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:34.342984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d433d8-2b9e-4779-8199-ea4302e523df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:34.344450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d433d8-2b9e-4779-8199-ea4302e523df None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:34.378404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:34.448490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 164/316] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:34.453761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3daccf-8c5c-4f3e-b6c9-08916d98871d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:34.562720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3daccf-8c5c-4f3e-b6c9-08916d98871d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:34.598371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b6efb-b09c-4770-ac78-ae73a5162a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:34.599343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6efb-b09c-4770-ac78-ae73a5162a69 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:34.599823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6efb-b09c-4770-ac78-ae73a5162a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:34.600362 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6efb-b09c-4770-ac78-ae73a5162a69 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:34.601710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b6efb-b09c-4770-ac78-ae73a5162a69 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:34.604106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b6efb-b09c-4770-ac78-ae73a5162a69 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:34.606364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 153/317] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:34 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:34.611877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d433d8-2b9e-4779-8199-ea4302e523df None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:34.711404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d433d8-2b9e-4779-8199-ea4302e523df None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:34.745741 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fd3ee-a586-4018-926d-070062dd11dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:34.746355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd3ee-a586-4018-926d-070062dd11dc None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:34.746931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd3ee-a586-4018-926d-070062dd11dc None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:34.747200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd3ee-a586-4018-926d-070062dd11dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:34.747988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fd3ee-a586-4018-926d-070062dd11dc None admin] RBAC: Adding query filter params (role.id=771965b80b7e437fbedb3867eb4b6114, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a, user.id=6862b24f6c9644139152b0d795946b3a) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:34.748293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fd3ee-a586-4018-926d-070062dd11dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:34.749728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fd3ee-a586-4018-926d-070062dd11dc None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:34.751567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:34.756019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 165/318] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:55:34 2022] GET /identity/v3/role_assignments?user.id=6862b24f6c9644139152b0d795946b3a&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=771965b80b7e437fbedb3867eb4b6114 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:35.249247 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ec0f5-d3b7-4695-9b22-abb281a4a71b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.249490 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ec0f5-d3b7-4695-9b22-abb281a4a71b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.249843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ec0f5-d3b7-4695-9b22-abb281a4a71b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.251400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 154/319] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:35.256543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8894-f6c8-4d32-842d-00b6f0826abf None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.257015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8894-f6c8-4d32-842d-00b6f0826abf None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.257088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8894-f6c8-4d32-842d-00b6f0826abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.275778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-cb1a8894-f6c8-4d32-842d-00b6f0826abf None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:35.276959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-cb1a8894-f6c8-4d32-842d-00b6f0826abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:35.345919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 166/320] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:35.347856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee1c0c-f242-4080-834c-3d4d52aa52b8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.348153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee1c0c-f242-4080-834c-3d4d52aa52b8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.348432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee1c0c-f242-4080-834c-3d4d52aa52b8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.349800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 155/321] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:35.355144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d6c27-dd1b-4a29-81de-93d53f0788fa None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.355433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d6c27-dd1b-4a29-81de-93d53f0788fa None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.355701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d6c27-dd1b-4a29-81de-93d53f0788fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.368306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee1c0c-f242-4080-834c-3d4d52aa52b8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:35.374109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-099d6c27-dd1b-4a29-81de-93d53f0788fa None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:35.375365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-099d6c27-dd1b-4a29-81de-93d53f0788fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:35.433744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:35.442695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 167/322] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:35.443952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184be2dd-5014-4876-bd2a-162025a0b839 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.444238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184be2dd-5014-4876-bd2a-162025a0b839 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.444513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184be2dd-5014-4876-bd2a-162025a0b839 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.445776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 168/323] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:35.451556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d67a4-40bd-487d-9d4b-f3d3ef1d7919 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.451844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d67a4-40bd-487d-9d4b-f3d3ef1d7919 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.452120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d67a4-40bd-487d-9d4b-f3d3ef1d7919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.472242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f52d67a4-40bd-487d-9d4b-f3d3ef1d7919 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:35.473427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f52d67a4-40bd-487d-9d4b-f3d3ef1d7919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:35.479160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee1c0c-f242-4080-834c-3d4d52aa52b8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:35.516860 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd9de-5521-4c4a-8031-a25cd9a51178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:35.517421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd9de-5521-4c4a-8031-a25cd9a51178 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.517699 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd9de-5521-4c4a-8031-a25cd9a51178 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.517971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd9de-5521-4c4a-8031-a25cd9a51178 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.529413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbd9de-5521-4c4a-8031-a25cd9a51178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:35.532137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d6dbd9de-5521-4c4a-8031-a25cd9a51178 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:35.534737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:35.535688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:35.536645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 156/324] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:35.537549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd9de-5521-4c4a-8031-a25cd9a51178 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:35.551869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 169/325] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:35.552703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d67a4-40bd-487d-9d4b-f3d3ef1d7919 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:35.648785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd9de-5521-4c4a-8031-a25cd9a51178 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:35.660532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d67a4-40bd-487d-9d4b-f3d3ef1d7919 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:35.670645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:35.683478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be4105-59c2-407b-8b2f-1b0532ecc1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:35.684117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be4105-59c2-407b-8b2f-1b0532ecc1bc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.684396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be4105-59c2-407b-8b2f-1b0532ecc1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.684674 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be4105-59c2-407b-8b2f-1b0532ecc1bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.694796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be4105-59c2-407b-8b2f-1b0532ecc1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:35.695237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aff78-cc6a-4dae-9a08-d74c855e53e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:35.695846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aff78-cc6a-4dae-9a08-d74c855e53e7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.696126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aff78-cc6a-4dae-9a08-d74c855e53e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.696399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aff78-cc6a-4dae-9a08-d74c855e53e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.697146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4aff78-cc6a-4dae-9a08-d74c855e53e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:35.697451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4aff78-cc6a-4dae-9a08-d74c855e53e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:35.698868 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4aff78-cc6a-4dae-9a08-d74c855e53e7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-29be4105-59c2-407b-8b2f-1b0532ecc1bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:35.700091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:35.701015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:35.701784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 157/326] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:35.702432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be4105-59c2-407b-8b2f-1b0532ecc1bc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:35.711975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 170/327] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:35.711975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aff78-cc6a-4dae-9a08-d74c855e53e7 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:35.759348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:35.802640 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be4105-59c2-407b-8b2f-1b0532ecc1bc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:35.809203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aff78-cc6a-4dae-9a08-d74c855e53e7 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:35.835046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a206-cc0c-4d5a-b38f-17fe1cc64428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:35.835676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a206-cc0c-4d5a-b38f-17fe1cc64428 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.835949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a206-cc0c-4d5a-b38f-17fe1cc64428 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.836216 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a206-cc0c-4d5a-b38f-17fe1cc64428 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.837392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a206-cc0c-4d5a-b38f-17fe1cc64428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:35.838861 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a206-cc0c-4d5a-b38f-17fe1cc64428 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:35.840437 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 158/328] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:35.841183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a206-cc0c-4d5a-b38f-17fe1cc64428 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:35.842139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edc012-020e-47bb-8b67-2dada29558c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:35.842779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edc012-020e-47bb-8b67-2dada29558c4 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.843059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edc012-020e-47bb-8b67-2dada29558c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.843333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edc012-020e-47bb-8b67-2dada29558c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.844052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edc012-020e-47bb-8b67-2dada29558c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:35.844362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edc012-020e-47bb-8b67-2dada29558c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:35.845901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edc012-020e-47bb-8b67-2dada29558c4 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:35.854901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 171/329] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:35.855660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edc012-020e-47bb-8b67-2dada29558c4 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:35.890820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:35.943017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a206-cc0c-4d5a-b38f-17fe1cc64428 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:35.958219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edc012-020e-47bb-8b67-2dada29558c4 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:35.971108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:35.976012 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229663-cca8-4199-8716-6d799a24fd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:35.976656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229663-cca8-4199-8716-6d799a24fd45 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.976939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229663-cca8-4199-8716-6d799a24fd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.977220 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229663-cca8-4199-8716-6d799a24fd45 None admin] PATH_INFO: `/v3/users/53b6eba8181a4d6dac1bba7458cbe44d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.978941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229663-cca8-4199-8716-6d799a24fd45 None admin] RBAC: Authorizing `identity:get_user(user_id=53b6eba8181a4d6dac1bba7458cbe44d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:35.980375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229663-cca8-4199-8716-6d799a24fd45 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:35.981989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 159/330] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:35 2022] GET /identity/v3/users/53b6eba8181a4d6dac1bba7458cbe44d => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:35.982781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229663-cca8-4199-8716-6d799a24fd45 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:35.997437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dc982-d104-4404-b472-be2a5ce4ce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:35.998050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dc982-d104-4404-b472-be2a5ce4ce6d None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:35.998327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dc982-d104-4404-b472-be2a5ce4ce6d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:35.998625 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dc982-d104-4404-b472-be2a5ce4ce6d None admin] PATH_INFO: `/v3/groups` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:35.999280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dc982-d104-4404-b472-be2a5ce4ce6d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:36.000687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dc982-d104-4404-b472-be2a5ce4ce6d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:36.015577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 172/331] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Jul 28 01:55:35 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:36.016412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dc982-d104-4404-b472-be2a5ce4ce6d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:36.103686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229663-cca8-4199-8716-6d799a24fd45 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:36.123839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:36.131815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dc982-d104-4404-b472-be2a5ce4ce6d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:36.143168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d695f-e22d-4caf-824d-6b4ceb246082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:36.143824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d695f-e22d-4caf-824d-6b4ceb246082 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:36.144103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d695f-e22d-4caf-824d-6b4ceb246082 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:36.144376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d695f-e22d-4caf-824d-6b4ceb246082 None admin] PATH_INFO: `/v3/users/8346176b44ff43aaafcab320e9b1728d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:36.145582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d695f-e22d-4caf-824d-6b4ceb246082 None admin] RBAC: Authorizing `identity:get_user(user_id=8346176b44ff43aaafcab320e9b1728d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:36.147119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d695f-e22d-4caf-824d-6b4ceb246082 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:36.148980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 160/332] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:35 2022] GET /identity/v3/users/8346176b44ff43aaafcab320e9b1728d => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:36.155056 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d695f-e22d-4caf-824d-6b4ceb246082 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:36.173841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b183d9c-a833-4b84-8f83-d8d71b7a6179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:36.174508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b183d9c-a833-4b84-8f83-d8d71b7a6179 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:36.174794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b183d9c-a833-4b84-8f83-d8d71b7a6179 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:36.175067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b183d9c-a833-4b84-8f83-d8d71b7a6179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:36.175874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b183d9c-a833-4b84-8f83-d8d71b7a6179 None admin] RBAC: Adding query filter params (role.id=55fc2032ca914d2fb1ec5cbd52f60e54, user.id=53b6eba8181a4d6dac1bba7458cbe44d, scope.system=all) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:36.176180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b183d9c-a833-4b84-8f83-d8d71b7a6179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:36.177635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b183d9c-a833-4b84-8f83-d8d71b7a6179 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:36.192284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 173/333] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Jul 28 01:55:36 2022] GET /identity/v3/role_assignments?user.id=53b6eba8181a4d6dac1bba7458cbe44d&scope.system=all&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:36.276051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d695f-e22d-4caf-824d-6b4ceb246082 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:36.315957 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59b32d-8d15-4da9-a4a9-4f24ca933404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:36.316614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59b32d-8d15-4da9-a4a9-4f24ca933404 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:36.316904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59b32d-8d15-4da9-a4a9-4f24ca933404 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:36.317181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59b32d-8d15-4da9-a4a9-4f24ca933404 None admin] PATH_INFO: `/v3/system/users/8346176b44ff43aaafcab320e9b1728d/roles/771965b80b7e437fbedb3867eb4b6114` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:36.318722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59b32d-8d15-4da9-a4a9-4f24ca933404 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8346176b44ff43aaafcab320e9b1728d, role_id=771965b80b7e437fbedb3867eb4b6114)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:36.320136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59b32d-8d15-4da9-a4a9-4f24ca933404 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:36.331618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 161/334] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Jul 28 01:55:36 2022] PUT /identity/v3/system/users/8346176b44ff43aaafcab320e9b1728d/roles/771965b80b7e437fbedb3867eb4b6114 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 01:55:38.403856 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2587b-c678-4b5b-ab8e-d2a74c9e082c None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:38.404854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2587b-c678-4b5b-ab8e-d2a74c9e082c None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:38.405338 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2587b-c678-4b5b-ab8e-d2a74c9e082c None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:38.406917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 174/335] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:38.412229 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9f5e-7cc0-4462-8628-5bf831f43050 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:38.412624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9f5e-7cc0-4462-8628-5bf831f43050 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:38.412825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9f5e-7cc0-4462-8628-5bf831f43050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:38.437300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c5eb9f5e-7cc0-4462-8628-5bf831f43050 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:38.438490 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c5eb9f5e-7cc0-4462-8628-5bf831f43050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:38.490911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be111-3972-4b31-9984-b4e5bdf9a19d None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:38.491522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be111-3972-4b31-9984-b4e5bdf9a19d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:38.491993 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be111-3972-4b31-9984-b4e5bdf9a19d None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:38.494505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 175/336] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:38.500563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:38.526401 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9db42f-ea96-4192-b917-c224ac05147e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:38.527110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9db42f-ea96-4192-b917-c224ac05147e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:38.527343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 162/337] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:38.527782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9db42f-ea96-4192-b917-c224ac05147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:38.562665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb9f5e-7cc0-4462-8628-5bf831f43050 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:38.567123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-fa9db42f-ea96-4192-b917-c224ac05147e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:38.568628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fa9db42f-ea96-4192-b917-c224ac05147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:38.624195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:38.723015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb9f5e-7cc0-4462-8628-5bf831f43050 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:38.746844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 176/338] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:38.777296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e289296-cbe9-4368-ae82-3f6dbe33bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:38.777946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e289296-cbe9-4368-ae82-3f6dbe33bd6d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:38.778276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e289296-cbe9-4368-ae82-3f6dbe33bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:38.778574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e289296-cbe9-4368-ae82-3f6dbe33bd6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:38.796965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e289296-cbe9-4368-ae82-3f6dbe33bd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0e289296-cbe9-4368-ae82-3f6dbe33bd6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:38.801880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:38.802799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:38.803579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 163/339] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:38.809527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9db42f-ea96-4192-b917-c224ac05147e None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:38.816909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e289296-cbe9-4368-ae82-3f6dbe33bd6d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:38.886798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:38.964871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e289296-cbe9-4368-ae82-3f6dbe33bd6d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:39.020171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3572a-2c5b-45c8-8bab-36995faa66b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:39.020747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3572a-2c5b-45c8-8bab-36995faa66b3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:39.021027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3572a-2c5b-45c8-8bab-36995faa66b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:39.021333 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3572a-2c5b-45c8-8bab-36995faa66b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:39.055052 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3572a-2c5b-45c8-8bab-36995faa66b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:39.057522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9db42f-ea96-4192-b917-c224ac05147e None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4cb3572a-2c5b-45c8-8bab-36995faa66b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:39.060701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:39.061582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:39.062358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 164/340] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:39.071445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3572a-2c5b-45c8-8bab-36995faa66b3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:39.106591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473e5c5-3228-44fe-bae6-4e5e436e7883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:39.107611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473e5c5-3228-44fe-bae6-4e5e436e7883 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:39.108133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473e5c5-3228-44fe-bae6-4e5e436e7883 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:39.108604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473e5c5-3228-44fe-bae6-4e5e436e7883 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:39.109543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473e5c5-3228-44fe-bae6-4e5e436e7883 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:39.110042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473e5c5-3228-44fe-bae6-4e5e436e7883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:39.111659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473e5c5-3228-44fe-bae6-4e5e436e7883 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:39.126038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 177/341] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:39.131580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473e5c5-3228-44fe-bae6-4e5e436e7883 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:39.201173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:39.266091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473e5c5-3228-44fe-bae6-4e5e436e7883 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:39.311112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b983029-d280-4ec2-9b11-fa6a4eeab5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:39.312112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983029-d280-4ec2-9b11-fa6a4eeab5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:39.312568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983029-d280-4ec2-9b11-fa6a4eeab5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:39.313027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983029-d280-4ec2-9b11-fa6a4eeab5b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:39.391061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b983029-d280-4ec2-9b11-fa6a4eeab5b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:39.393207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:39.394627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b983029-d280-4ec2-9b11-fa6a4eeab5b1 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:39.404368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3572a-2c5b-45c8-8bab-36995faa66b3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:39.433021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:39.491411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea241b8-9243-418c-90ea-773dbad5fc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:39.492041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea241b8-9243-418c-90ea-773dbad5fc43 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:39.492322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea241b8-9243-418c-90ea-773dbad5fc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:39.492596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea241b8-9243-418c-90ea-773dbad5fc43 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:39.493347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea241b8-9243-418c-90ea-773dbad5fc43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:39.493659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea241b8-9243-418c-90ea-773dbad5fc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:39.495992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea241b8-9243-418c-90ea-773dbad5fc43 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:39.504514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 165/342] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:39.505694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577d6b4-6c55-4563-94c6-e9e0e579432d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:39.505986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577d6b4-6c55-4563-94c6-e9e0e579432d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:39.506264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577d6b4-6c55-4563-94c6-e9e0e579432d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:39.510658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 166/343] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:39.511972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da8889-2ef6-4c66-bf4b-76ebc4fc1da4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:39.512359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da8889-2ef6-4c66-bf4b-76ebc4fc1da4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:39.512660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 178/344] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 01:55:39.512800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da8889-2ef6-4c66-bf4b-76ebc4fc1da4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:39.513769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b983029-d280-4ec2-9b11-fa6a4eeab5b1 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:39.514347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 167/345] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:39.519479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e11ab-ed3f-491d-adb7-9411c1b53931 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:39.519865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e11ab-ed3f-491d-adb7-9411c1b53931 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:39.520243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e11ab-ed3f-491d-adb7-9411c1b53931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:39.544211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e52e11ab-ed3f-491d-adb7-9411c1b53931 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:39.545570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e52e11ab-ed3f-491d-adb7-9411c1b53931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:39.632391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 168/346] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:39.639147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895994bd-ceac-48f4-bbbc-9e792dd2b5d0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:39.641819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895994bd-ceac-48f4-bbbc-9e792dd2b5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:39.642277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895994bd-ceac-48f4-bbbc-9e792dd2b5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:39.675690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-895994bd-ceac-48f4-bbbc-9e792dd2b5d0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:39.677122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-895994bd-ceac-48f4-bbbc-9e792dd2b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:39.682239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b983029-d280-4ec2-9b11-fa6a4eeab5b1 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:39.712905 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:39.730760 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8462e4-a4c2-47b9-adf1-fb594c3b0ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:39.731527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8462e4-a4c2-47b9-adf1-fb594c3b0ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:39.731943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8462e4-a4c2-47b9-adf1-fb594c3b0ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:39.732326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8462e4-a4c2-47b9-adf1-fb594c3b0ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:39.764029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 169/347] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:39.765126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895994bd-ceac-48f4-bbbc-9e792dd2b5d0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:39.789409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:39.817727 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8462e4-a4c2-47b9-adf1-fb594c3b0ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:39.819677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8462e4-a4c2-47b9-adf1-fb594c3b0ee3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:39.885660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895994bd-ceac-48f4-bbbc-9e792dd2b5d0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:39.922891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c2051-af81-43ab-9c5c-408519c0b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:39.923544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c2051-af81-43ab-9c5c-408519c0b24e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:39.923819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c2051-af81-43ab-9c5c-408519c0b24e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:39.924088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c2051-af81-43ab-9c5c-408519c0b24e None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:39.925252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c2051-af81-43ab-9c5c-408519c0b24e None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:39.927053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c2051-af81-43ab-9c5c-408519c0b24e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:39.928707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 170/348] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:39 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:39.929500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c2051-af81-43ab-9c5c-408519c0b24e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:39.932872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 179/349] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:39.933681 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8462e4-a4c2-47b9-adf1-fb594c3b0ee3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:39.964100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:40.054966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:40.063765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8462e4-a4c2-47b9-adf1-fb594c3b0ee3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:40.069952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c2051-af81-43ab-9c5c-408519c0b24e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:40.105921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f8c12-3c64-4237-8ce8-02dadfedd26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:40.106965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f8c12-3c64-4237-8ce8-02dadfedd26d None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.107425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f8c12-3c64-4237-8ce8-02dadfedd26d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.107803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f8c12-3c64-4237-8ce8-02dadfedd26d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.117795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0225e-385d-4a2b-91d8-a8e7fbd2d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:40.118120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f8c12-3c64-4237-8ce8-02dadfedd26d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:40.119203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0225e-385d-4a2b-91d8-a8e7fbd2d6bb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.119486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0225e-385d-4a2b-91d8-a8e7fbd2d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.121317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0225e-385d-4a2b-91d8-a8e7fbd2d6bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-514f8c12-3c64-4237-8ce8-02dadfedd26d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:40.123738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:40.124694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:40.125496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 180/350] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:40.128504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77f7c-14e9-4f91-a71d-4c5b14c3bd96 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.128786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77f7c-14e9-4f91-a71d-4c5b14c3bd96 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.129072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77f7c-14e9-4f91-a71d-4c5b14c3bd96 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.130738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0225e-385d-4a2b-91d8-a8e7fbd2d6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:40.131287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 181/351] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:40.132026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae77f7c-14e9-4f91-a71d-4c5b14c3bd96 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-47d0225e-385d-4a2b-91d8-a8e7fbd2d6bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:40.139607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:40.140504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:40.141287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 171/352] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:40.141952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0225e-385d-4a2b-91d8-a8e7fbd2d6bb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:40.251694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:40.280747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae77f7c-14e9-4f91-a71d-4c5b14c3bd96 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:40.284744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0225e-385d-4a2b-91d8-a8e7fbd2d6bb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:40.325536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ec4d-7146-4d01-8fa1-83fb0624a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:40.326513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ec4d-7146-4d01-8fa1-83fb0624a9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.326975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ec4d-7146-4d01-8fa1-83fb0624a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.327249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ec4d-7146-4d01-8fa1-83fb0624a9a7 None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.332159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867bec0-416c-47fb-bade-f2497aa09b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:40.332811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867bec0-416c-47fb-bade-f2497aa09b6e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.333115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867bec0-416c-47fb-bade-f2497aa09b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.333389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867bec0-416c-47fb-bade-f2497aa09b6e None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.333666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ec4d-7146-4d01-8fa1-83fb0624a9a7 None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:40.334661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867bec0-416c-47fb-bade-f2497aa09b6e None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:40.335187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ec4d-7146-4d01-8fa1-83fb0624a9a7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:40.336119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867bec0-416c-47fb-bade-f2497aa09b6e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:40.337036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 182/353] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:40 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:40.337649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ec4d-7146-4d01-8fa1-83fb0624a9a7 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:40.338843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 172/354] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:40 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:40.340017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b110e0-343c-4e11-ab4d-93e8bd08daa9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.340493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b110e0-343c-4e11-ab4d-93e8bd08daa9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.340768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b110e0-343c-4e11-ab4d-93e8bd08daa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.362497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-86b110e0-343c-4e11-ab4d-93e8bd08daa9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:40.364232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-86b110e0-343c-4e11-ab4d-93e8bd08daa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:40.380489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:40.441580 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 173/355] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:40.442356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b110e0-343c-4e11-ab4d-93e8bd08daa9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:40.464384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ec4d-7146-4d01-8fa1-83fb0624a9a7 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:40.514077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe2035-7a99-4a0e-ae78-960458d38654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:40.514759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe2035-7a99-4a0e-ae78-960458d38654 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.515045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe2035-7a99-4a0e-ae78-960458d38654 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.515319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe2035-7a99-4a0e-ae78-960458d38654 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.516052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe2035-7a99-4a0e-ae78-960458d38654 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:40.516359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe2035-7a99-4a0e-ae78-960458d38654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:40.517742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe2035-7a99-4a0e-ae78-960458d38654 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:40.526230 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 183/356] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:40.527616 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e96c5-0b56-4dc8-88fc-57793a0ae955 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.527911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e96c5-0b56-4dc8-88fc-57793a0ae955 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.528192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e96c5-0b56-4dc8-88fc-57793a0ae955 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.529422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 184/357] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:40.530182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e96c5-0b56-4dc8-88fc-57793a0ae955 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:40.541765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:40.578523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b110e0-343c-4e11-ab4d-93e8bd08daa9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:40.624687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0e58-9243-4ba8-98d5-accec6fb7427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:40.625322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0e58-9243-4ba8-98d5-accec6fb7427 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.625605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0e58-9243-4ba8-98d5-accec6fb7427 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.625879 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0e58-9243-4ba8-98d5-accec6fb7427 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.626907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add0e58-9243-4ba8-98d5-accec6fb7427 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:40.626907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add0e58-9243-4ba8-98d5-accec6fb7427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:40.629541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add0e58-9243-4ba8-98d5-accec6fb7427 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:40.638227 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 174/358] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:40.639100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0e58-9243-4ba8-98d5-accec6fb7427 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:40.653778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:40.662424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e96c5-0b56-4dc8-88fc-57793a0ae955 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:40.707608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57810a-a5a2-44c2-a7bb-3e5e3b4d34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:40.708591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57810a-a5a2-44c2-a7bb-3e5e3b4d34fa None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.708878 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57810a-a5a2-44c2-a7bb-3e5e3b4d34fa None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.709155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57810a-a5a2-44c2-a7bb-3e5e3b4d34fa None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.710320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57810a-a5a2-44c2-a7bb-3e5e3b4d34fa None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:40.711836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57810a-a5a2-44c2-a7bb-3e5e3b4d34fa None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:40.713975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 185/359] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:40 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:40.714773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57810a-a5a2-44c2-a7bb-3e5e3b4d34fa None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:40.761930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0e58-9243-4ba8-98d5-accec6fb7427 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:40.802186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd688b55-bda6-4675-8d2d-40369765a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:40.802846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd688b55-bda6-4675-8d2d-40369765a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.803128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd688b55-bda6-4675-8d2d-40369765a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.803493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd688b55-bda6-4675-8d2d-40369765a9f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.803946 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:40.804369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd688b55-bda6-4675-8d2d-40369765a9f6 None admin] RBAC: Adding query filter params (group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role.id=42afac3d251b45ed822081a66ad20d6d, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:40.804690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd688b55-bda6-4675-8d2d-40369765a9f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:40.806169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd688b55-bda6-4675-8d2d-40369765a9f6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:40.812712 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 175/360] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jul 28 01:55:40 2022] GET /identity/v3/role_assignments?group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=42afac3d251b45ed822081a66ad20d6d => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:40.813370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd688b55-bda6-4675-8d2d-40369765a9f6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:40.835797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57810a-a5a2-44c2-a7bb-3e5e3b4d34fa None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:40.900238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5314b7-f779-4ad9-8978-1a51b829646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:40.900238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5314b7-f779-4ad9-8978-1a51b829646b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.900238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5314b7-f779-4ad9-8978-1a51b829646b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.900238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5314b7-f779-4ad9-8978-1a51b829646b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.912684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5314b7-f779-4ad9-8978-1a51b829646b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-af5314b7-f779-4ad9-8978-1a51b829646b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:40.919716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:40.920728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 186/361] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:40.922504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b76b1-dccf-4176-b907-9a2c950ab68e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:40.923280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b76b1-dccf-4176-b907-9a2c950ab68e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:40.923280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b76b1-dccf-4176-b907-9a2c950ab68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:40.936191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:40.946051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ad7b76b1-dccf-4176-b907-9a2c950ab68e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:40.947854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ad7b76b1-dccf-4176-b907-9a2c950ab68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:40.983759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd688b55-bda6-4675-8d2d-40369765a9f6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:41.028705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa1a0b-1c23-47ae-adf8-129a07f43218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:41.029365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa1a0b-1c23-47ae-adf8-129a07f43218 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:41.029648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa1a0b-1c23-47ae-adf8-129a07f43218 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:41.029924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa1a0b-1c23-47ae-adf8-129a07f43218 None admin] PATH_INFO: `/v3/users/8346176b44ff43aaafcab320e9b1728d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:41.032165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa1a0b-1c23-47ae-adf8-129a07f43218 None admin] RBAC: Authorizing `identity:get_user(user_id=8346176b44ff43aaafcab320e9b1728d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:41.033622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa1a0b-1c23-47ae-adf8-129a07f43218 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:41.035494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 176/362] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:55:40 2022] GET /identity/v3/users/8346176b44ff43aaafcab320e9b1728d => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:41.036078 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa1a0b-1c23-47ae-adf8-129a07f43218 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:41.038473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 187/363] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:41.043127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b76b1-dccf-4176-b907-9a2c950ab68e None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:41.126409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:41.170909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa1a0b-1c23-47ae-adf8-129a07f43218 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:41.180480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b76b1-dccf-4176-b907-9a2c950ab68e None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:41.221329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b0f8f-3d55-4ff4-a330-064b7a1f2706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:41.222422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b0f8f-3d55-4ff4-a330-064b7a1f2706 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:41.222972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b0f8f-3d55-4ff4-a330-064b7a1f2706 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:41.223467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b0f8f-3d55-4ff4-a330-064b7a1f2706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:41.227694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bad3ae-d8e0-4261-90f8-ab45f23e986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:41.228512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bad3ae-d8e0-4261-90f8-ab45f23e986e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:41.228790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bad3ae-d8e0-4261-90f8-ab45f23e986e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:41.229057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bad3ae-d8e0-4261-90f8-ab45f23e986e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:41.229852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bad3ae-d8e0-4261-90f8-ab45f23e986e None admin] RBAC: Adding query filter params (group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role.id=55fc2032ca914d2fb1ec5cbd52f60e54, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:41.230158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bad3ae-d8e0-4261-90f8-ab45f23e986e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:41.231671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bad3ae-d8e0-4261-90f8-ab45f23e986e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:41.238737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 188/364] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jul 28 01:55:41 2022] GET /identity/v3/role_assignments?group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:41.239341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bad3ae-d8e0-4261-90f8-ab45f23e986e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:41.242648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:41.323629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b0f8f-3d55-4ff4-a330-064b7a1f2706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:41.326023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b0f8f-3d55-4ff4-a330-064b7a1f2706 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:41.391710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bad3ae-d8e0-4261-90f8-ab45f23e986e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:41.434193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:41.441422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fdcf4-c930-4ba8-8bcd-6b5879176808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:41.442054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fdcf4-c930-4ba8-8bcd-6b5879176808 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:41.442331 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fdcf4-c930-4ba8-8bcd-6b5879176808 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:41.442651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fdcf4-c930-4ba8-8bcd-6b5879176808 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:41.443929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fdcf4-c930-4ba8-8bcd-6b5879176808 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:41.444296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fdcf4-c930-4ba8-8bcd-6b5879176808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:41.445789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fdcf4-c930-4ba8-8bcd-6b5879176808 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:41.457629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 189/365] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:41.458634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fdcf4-c930-4ba8-8bcd-6b5879176808 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:41.464368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 177/366] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:41.465307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b0f8f-3d55-4ff4-a330-064b7a1f2706 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:41.526903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:41.602688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b0f8f-3d55-4ff4-a330-064b7a1f2706 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:41.604267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fdcf4-c930-4ba8-8bcd-6b5879176808 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:41.644106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be39818-122a-41ae-8aa7-d5ff70ae14ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:41.644754 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be39818-122a-41ae-8aa7-d5ff70ae14ff None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:41.645033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be39818-122a-41ae-8aa7-d5ff70ae14ff None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:41.645306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be39818-122a-41ae-8aa7-d5ff70ae14ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:41.646364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3757f-9bd8-495e-bc0f-d019d8eec76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:41.646996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3757f-9bd8-495e-bc0f-d019d8eec76f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:41.647274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3757f-9bd8-495e-bc0f-d019d8eec76f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:41.647541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3757f-9bd8-495e-bc0f-d019d8eec76f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:41.648330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3757f-9bd8-495e-bc0f-d019d8eec76f None admin] RBAC: Adding query filter params (role.id=771965b80b7e437fbedb3867eb4b6114, user.id=8346176b44ff43aaafcab320e9b1728d, scope.system=all) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:41.648642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3757f-9bd8-495e-bc0f-d019d8eec76f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:41.650114 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3757f-9bd8-495e-bc0f-d019d8eec76f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:41.662399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be39818-122a-41ae-8aa7-d5ff70ae14ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:41.664002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 190/367] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Jul 28 01:55:41 2022] GET /identity/v3/role_assignments?user.id=8346176b44ff43aaafcab320e9b1728d&scope.system=all&role.id=771965b80b7e437fbedb3867eb4b6114 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:41.664833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3757f-9bd8-495e-bc0f-d019d8eec76f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5be39818-122a-41ae-8aa7-d5ff70ae14ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:41.669053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:41.669961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:41.670784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:41.673305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 178/368] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:55:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:41.674486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be39818-122a-41ae-8aa7-d5ff70ae14ff None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:41.749149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:41.831569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be39818-122a-41ae-8aa7-d5ff70ae14ff None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:41.835071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:41.860475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3757f-9bd8-495e-bc0f-d019d8eec76f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:41.904732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36404738-85ce-481d-9a9f-94967aa18312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:41.905776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36404738-85ce-481d-9a9f-94967aa18312 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:41.906261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36404738-85ce-481d-9a9f-94967aa18312 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:41.906769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36404738-85ce-481d-9a9f-94967aa18312 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:41.911398 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36404738-85ce-481d-9a9f-94967aa18312 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:41.913226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36404738-85ce-481d-9a9f-94967aa18312 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:41.916133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 179/369] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:41 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:41.917211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36404738-85ce-481d-9a9f-94967aa18312 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:41.930595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484812d-1791-4d99-aae2-7f14e0b1b933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:41.931794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484812d-1791-4d99-aae2-7f14e0b1b933 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:41.932078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484812d-1791-4d99-aae2-7f14e0b1b933 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:41.932350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484812d-1791-4d99-aae2-7f14e0b1b933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:42.023471 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484812d-1791-4d99-aae2-7f14e0b1b933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:42.025873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484812d-1791-4d99-aae2-7f14e0b1b933 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:42.061676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36404738-85ce-481d-9a9f-94967aa18312 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:42.090796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:42.101327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea572ab-a8fc-41d7-8316-c1e87eb3fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:42.102007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea572ab-a8fc-41d7-8316-c1e87eb3fe7d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:42.102361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea572ab-a8fc-41d7-8316-c1e87eb3fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:42.103312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea572ab-a8fc-41d7-8316-c1e87eb3fe7d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:42.104205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea572ab-a8fc-41d7-8316-c1e87eb3fe7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:42.104461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea572ab-a8fc-41d7-8316-c1e87eb3fe7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:42.105952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea572ab-a8fc-41d7-8316-c1e87eb3fe7d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:42.119395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 180/370] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:42.119777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea572ab-a8fc-41d7-8316-c1e87eb3fe7d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:42.163004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:42.164825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 191/371] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:42.166796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484812d-1791-4d99-aae2-7f14e0b1b933 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:42.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea572ab-a8fc-41d7-8316-c1e87eb3fe7d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:42.285633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484812d-1791-4d99-aae2-7f14e0b1b933 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:42.297874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0dfd3-195d-4770-9a8f-605062180f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:42.298652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0dfd3-195d-4770-9a8f-605062180f2e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:42.299000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0dfd3-195d-4770-9a8f-605062180f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:42.299399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0dfd3-195d-4770-9a8f-605062180f2e None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:42.300824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0dfd3-195d-4770-9a8f-605062180f2e None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:42.302304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0dfd3-195d-4770-9a8f-605062180f2e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:42.309192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 181/372] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:42 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:42.310102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0dfd3-195d-4770-9a8f-605062180f2e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:42.327883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8ce26-37b8-4beb-b0c1-6d0f089c645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:42.328596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8ce26-37b8-4beb-b0c1-6d0f089c645a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:42.328939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8ce26-37b8-4beb-b0c1-6d0f089c645a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:42.329279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8ce26-37b8-4beb-b0c1-6d0f089c645a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:42.355487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:42.413213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8ce26-37b8-4beb-b0c1-6d0f089c645a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:42.415836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8ce26-37b8-4beb-b0c1-6d0f089c645a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:42.432803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:42.436495 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0dfd3-195d-4770-9a8f-605062180f2e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:42.480831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5aff5-3d1a-4a71-aa5f-9a85c257e6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:42.481575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5aff5-3d1a-4a71-aa5f-9a85c257e6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:42.481897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5aff5-3d1a-4a71-aa5f-9a85c257e6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:42.482168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5aff5-3d1a-4a71-aa5f-9a85c257e6f9 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:42.483464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5aff5-3d1a-4a71-aa5f-9a85c257e6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:42.484922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5aff5-3d1a-4a71-aa5f-9a85c257e6f9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:42.487046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 182/373] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:42 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:42.487838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5aff5-3d1a-4a71-aa5f-9a85c257e6f9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:42.557920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 192/374] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:42.558633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8ce26-37b8-4beb-b0c1-6d0f089c645a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:42.623487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:42.637143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5aff5-3d1a-4a71-aa5f-9a85c257e6f9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:42.685103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe426dd-deb5-4a8a-baf0-26215a518e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:42.685717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8ce26-37b8-4beb-b0c1-6d0f089c645a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:42.686340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe426dd-deb5-4a8a-baf0-26215a518e41 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:42.686939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe426dd-deb5-4a8a-baf0-26215a518e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:42.687764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe426dd-deb5-4a8a-baf0-26215a518e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:42.690218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe426dd-deb5-4a8a-baf0-26215a518e41 None admin] RBAC: Adding query filter params (group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role.id=55fc2032ca914d2fb1ec5cbd52f60e54, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:42.691124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe426dd-deb5-4a8a-baf0-26215a518e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:42.693203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe426dd-deb5-4a8a-baf0-26215a518e41 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:42.707116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 183/375] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jul 28 01:55:42 2022] GET /identity/v3/role_assignments?group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:42.707116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe426dd-deb5-4a8a-baf0-26215a518e41 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:42.746222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148aef8-3285-4bf0-a6a1-19fe3a39e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:42.746901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148aef8-3285-4bf0-a6a1-19fe3a39e19c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:42.747179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148aef8-3285-4bf0-a6a1-19fe3a39e19c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:42.747527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148aef8-3285-4bf0-a6a1-19fe3a39e19c None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:42.749023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148aef8-3285-4bf0-a6a1-19fe3a39e19c None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:42.752077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148aef8-3285-4bf0-a6a1-19fe3a39e19c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:42.755692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 193/376] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:42 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:42.760398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148aef8-3285-4bf0-a6a1-19fe3a39e19c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:42.774293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:42.922616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe426dd-deb5-4a8a-baf0-26215a518e41 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:42.959187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148aef8-3285-4bf0-a6a1-19fe3a39e19c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:42.973299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ac046-d7a6-48b7-b4c6-a3b45437e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:42.974347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ac046-d7a6-48b7-b4c6-a3b45437e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:42.974861 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ac046-d7a6-48b7-b4c6-a3b45437e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:42.975344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ac046-d7a6-48b7-b4c6-a3b45437e2f8 None admin] PATH_INFO: `/v3/projects/610fee5f9cbd481ca2b8410c0ec0c0c0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:42.979270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ac046-d7a6-48b7-b4c6-a3b45437e2f8 None admin] RBAC: Authorizing `identity:get_project(project_id=610fee5f9cbd481ca2b8410c0ec0c0c0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:42.981098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ac046-d7a6-48b7-b4c6-a3b45437e2f8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:42.981640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:42.984022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 184/377] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:42 2022] GET /identity/v3/projects/610fee5f9cbd481ca2b8410c0ec0c0c0 => generated 344 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:42.990164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ac046-d7a6-48b7-b4c6-a3b45437e2f8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:43.001016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f695a-d29f-4914-8044-f58633abcfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:43.001631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f695a-d29f-4914-8044-f58633abcfff None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:43.001909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f695a-d29f-4914-8044-f58633abcfff None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:43.002180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f695a-d29f-4914-8044-f58633abcfff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:43.003100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f695a-d29f-4914-8044-f58633abcfff None admin] RBAC: Adding query filter params (group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role.id=42afac3d251b45ed822081a66ad20d6d, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:43.003408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f695a-d29f-4914-8044-f58633abcfff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:43.004983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f695a-d29f-4914-8044-f58633abcfff None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:43.011332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 194/378] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jul 28 01:55:42 2022] GET /identity/v3/role_assignments?group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=42afac3d251b45ed822081a66ad20d6d => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:43.044629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834bf94-31a3-4957-9a02-1ef964f1d645 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:43.045071 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834bf94-31a3-4957-9a02-1ef964f1d645 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:43.045566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834bf94-31a3-4957-9a02-1ef964f1d645 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:43.047548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 195/379] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:43.053995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bff1b-3f14-4d4e-9238-633b5c586bb0 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:43.054717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bff1b-3f14-4d4e-9238-633b5c586bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:43.055247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bff1b-3f14-4d4e-9238-633b5c586bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:43.077082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-708bff1b-3f14-4d4e-9238-633b5c586bb0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:43.078716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-708bff1b-3f14-4d4e-9238-633b5c586bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:43.110653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:43.114364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ac046-d7a6-48b7-b4c6-a3b45437e2f8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:43.155749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0627d-999f-4f6c-a975-3319576a2e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:43.156651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0627d-999f-4f6c-a975-3319576a2e41 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:43.157091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0627d-999f-4f6c-a975-3319576a2e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:43.157510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0627d-999f-4f6c-a975-3319576a2e41 None admin] PATH_INFO: `/v3/groups/58aa937cbf084454ae0a708cb1ebc28a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:43.159232 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 196/380] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:43.164964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0627d-999f-4f6c-a975-3319576a2e41 None admin] RBAC: Authorizing `identity:get_group(group_id=58aa937cbf084454ae0a708cb1ebc28a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:43.166511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0627d-999f-4f6c-a975-3319576a2e41 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:43.168175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 185/381] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:42 2022] GET /identity/v3/groups/58aa937cbf084454ae0a708cb1ebc28a => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:43.174233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bff1b-3f14-4d4e-9238-633b5c586bb0 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:43.213320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0627d-999f-4f6c-a975-3319576a2e41 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:43.327263 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bff1b-3f14-4d4e-9238-633b5c586bb0 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:43.344570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:43.365479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0627d-999f-4f6c-a975-3319576a2e41 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:43.373231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2f2aa-3e76-4a9f-b917-aabfec6ec5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:43.374187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2f2aa-3e76-4a9f-b917-aabfec6ec5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:43.374698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2f2aa-3e76-4a9f-b917-aabfec6ec5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:43.375171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2f2aa-3e76-4a9f-b917-aabfec6ec5c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:43.376594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2f2aa-3e76-4a9f-b917-aabfec6ec5c3 None admin] RBAC: Adding query filter params (group.id=58aa937cbf084454ae0a708cb1ebc28a, role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=610fee5f9cbd481ca2b8410c0ec0c0c0) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:43.377451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2f2aa-3e76-4a9f-b917-aabfec6ec5c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:43.379450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2f2aa-3e76-4a9f-b917-aabfec6ec5c3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:43.388201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 197/382] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jul 28 01:55:43 2022] GET /identity/v3/role_assignments?group.id=58aa937cbf084454ae0a708cb1ebc28a&scope.project.id=610fee5f9cbd481ca2b8410c0ec0c0c0&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:43.407553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5075a-dada-40b5-82dd-6f9759b6f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:43.408134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5075a-dada-40b5-82dd-6f9759b6f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:43.408410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5075a-dada-40b5-82dd-6f9759b6f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:43.408682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5075a-dada-40b5-82dd-6f9759b6f7b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:43.421324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5075a-dada-40b5-82dd-6f9759b6f7b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8be5075a-dada-40b5-82dd-6f9759b6f7b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:43.427154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:43.428087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:43.428853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 186/383] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:43.436802 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2f2aa-3e76-4a9f-b917-aabfec6ec5c3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:43.597773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2f2aa-3e76-4a9f-b917-aabfec6ec5c3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:43.640030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0132b-f86a-498a-9334-a7489f7a6d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:43.640936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0132b-f86a-498a-9334-a7489f7a6d94 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:43.641215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0132b-f86a-498a-9334-a7489f7a6d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:43.641483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0132b-f86a-498a-9334-a7489f7a6d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:43.642201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0132b-f86a-498a-9334-a7489f7a6d94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:43.642614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0132b-f86a-498a-9334-a7489f7a6d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:43.644006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0132b-f86a-498a-9334-a7489f7a6d94 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:43.656793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 198/384] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:43.662721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5075a-dada-40b5-82dd-6f9759b6f7b4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:43.693540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:43.778045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831faae-f860-41bf-b3d9-6cdb91507db9 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:43.778389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831faae-f860-41bf-b3d9-6cdb91507db9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:43.778665 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831faae-f860-41bf-b3d9-6cdb91507db9 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:43.780141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 199/385] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:55:43.789336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539d836-ed89-478a-a869-839b82db8434 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:43.789619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539d836-ed89-478a-a869-839b82db8434 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:43.789892 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539d836-ed89-478a-a869-839b82db8434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:43.790947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5075a-dada-40b5-82dd-6f9759b6f7b4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:43.825793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f539d836-ed89-478a-a869-839b82db8434 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:43.827032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f539d836-ed89-478a-a869-839b82db8434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:43.847690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fb1f5-a620-4f0d-a2ea-46371d29afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:43.848347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fb1f5-a620-4f0d-a2ea-46371d29afe6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:43.848626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fb1f5-a620-4f0d-a2ea-46371d29afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:43.848900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fb1f5-a620-4f0d-a2ea-46371d29afe6 None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:43.851854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fb1f5-a620-4f0d-a2ea-46371d29afe6 None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:43.853352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fb1f5-a620-4f0d-a2ea-46371d29afe6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:43.854978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 187/386] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:43 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:43.863596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fb1f5-a620-4f0d-a2ea-46371d29afe6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:43.892978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:43.962755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 200/387] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:44.003546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539d836-ed89-478a-a869-839b82db8434 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:44.025492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fb1f5-a620-4f0d-a2ea-46371d29afe6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:44.062840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:44.067934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee2b72-95d6-4bee-a0ee-51cfec18e3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:44.068749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee2b72-95d6-4bee-a0ee-51cfec18e3cf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:44.069199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee2b72-95d6-4bee-a0ee-51cfec18e3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:44.069649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee2b72-95d6-4bee-a0ee-51cfec18e3cf None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:44.072484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee2b72-95d6-4bee-a0ee-51cfec18e3cf None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:44.079082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee2b72-95d6-4bee-a0ee-51cfec18e3cf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:44.087959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 188/388] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:43 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:44.103691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee2b72-95d6-4bee-a0ee-51cfec18e3cf None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:44.216636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539d836-ed89-478a-a869-839b82db8434 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:44.288015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee2b72-95d6-4bee-a0ee-51cfec18e3cf None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:44.301698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7211e6b-5cf6-494a-9d54-c03a9ca793d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:44.302340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7211e6b-5cf6-494a-9d54-c03a9ca793d8 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:44.304239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7211e6b-5cf6-494a-9d54-c03a9ca793d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:44.304685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7211e6b-5cf6-494a-9d54-c03a9ca793d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:44.326043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7211e6b-5cf6-494a-9d54-c03a9ca793d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-e7211e6b-5cf6-494a-9d54-c03a9ca793d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:44.332303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:44.333383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:44.334409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:44.338284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 201/389] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:44.344018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7211e6b-5cf6-494a-9d54-c03a9ca793d8 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:44.356393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c58a5-5dd0-4050-b389-95404c1711c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:44.357265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c58a5-5dd0-4050-b389-95404c1711c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:44.357701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c58a5-5dd0-4050-b389-95404c1711c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:44.358127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c58a5-5dd0-4050-b389-95404c1711c6 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4/roles/42afac3d251b45ed822081a66ad20d6d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:44.362185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c58a5-5dd0-4050-b389-95404c1711c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9874927d1bb641cba1df1d9d5a436cd5, group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role_id=42afac3d251b45ed822081a66ad20d6d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:44.363804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c58a5-5dd0-4050-b389-95404c1711c6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:44.387332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 189/390] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Jul 28 01:55:44 2022] PUT /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4/roles/42afac3d251b45ed822081a66ad20d6d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 01:55:44.394105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:44.493881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7211e6b-5cf6-494a-9d54-c03a9ca793d8 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:44.543801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549e3b1-847d-42bb-a127-ba860e675cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:44.544738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549e3b1-847d-42bb-a127-ba860e675cce None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:44.545161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549e3b1-847d-42bb-a127-ba860e675cce None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:44.545608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549e3b1-847d-42bb-a127-ba860e675cce None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:44.546532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549e3b1-847d-42bb-a127-ba860e675cce None admin] RBAC: Adding query filter params (name=member) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:44.546987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549e3b1-847d-42bb-a127-ba860e675cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:44.548563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549e3b1-847d-42bb-a127-ba860e675cce None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:44.563567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 202/391] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:44.569783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c58a5-5dd0-4050-b389-95404c1711c6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:44.600917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:44.688896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c58a5-5dd0-4050-b389-95404c1711c6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:44.724754 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2798b7a-f1aa-40cb-b93c-82f748fe2cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:44.725670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798b7a-f1aa-40cb-b93c-82f748fe2cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:44.726152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798b7a-f1aa-40cb-b93c-82f748fe2cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:44.726635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798b7a-f1aa-40cb-b93c-82f748fe2cd3 None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:44.728597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2798b7a-f1aa-40cb-b93c-82f748fe2cd3 None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:44.730250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2798b7a-f1aa-40cb-b93c-82f748fe2cd3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:44.732477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 190/392] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:44 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:44.738106 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549e3b1-847d-42bb-a127-ba860e675cce None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:44.853622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:44.866837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549e3b1-847d-42bb-a127-ba860e675cce None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:44.912347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0df02c-4794-4514-8409-f6de41c92d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:44.912989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0df02c-4794-4514-8409-f6de41c92d6e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:44.913269 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0df02c-4794-4514-8409-f6de41c92d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:44.913543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0df02c-4794-4514-8409-f6de41c92d6e None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:44.914737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0df02c-4794-4514-8409-f6de41c92d6e None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:44.916771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0df02c-4794-4514-8409-f6de41c92d6e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:44.918764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 203/393] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:44 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:44.927486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2798b7a-f1aa-40cb-b93c-82f748fe2cd3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:45.034285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:45.051195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2798b7a-f1aa-40cb-b93c-82f748fe2cd3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:45.098618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed39033-ec7d-4059-9268-c58902f6bf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:45.099298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed39033-ec7d-4059-9268-c58902f6bf90 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:45.099580 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed39033-ec7d-4059-9268-c58902f6bf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:45.099848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed39033-ec7d-4059-9268-c58902f6bf90 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:45.101785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed39033-ec7d-4059-9268-c58902f6bf90 None admin] RBAC: Authorizing `identity:create_grant(project_id=9874927d1bb641cba1df1d9d5a436cd5, group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:45.103887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed39033-ec7d-4059-9268-c58902f6bf90 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:45.125972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 191/394] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Jul 28 01:55:44 2022] PUT /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:45.164072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd098ce6-a4ce-49d7-a8be-8356a6d9eafe None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:45.164380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd098ce6-a4ce-49d7-a8be-8356a6d9eafe None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:45.164633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd098ce6-a4ce-49d7-a8be-8356a6d9eafe None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:45.166943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 204/395] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:45.184279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67daf6-a216-4939-8dc4-b654d4e652d5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:45.184612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67daf6-a216-4939-8dc4-b654d4e652d5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:45.184835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67daf6-a216-4939-8dc4-b654d4e652d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:45.209515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4d67daf6-a216-4939-8dc4-b654d4e652d5 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:45.210733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4d67daf6-a216-4939-8dc4-b654d4e652d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:45.305379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 192/396] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:45.331356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd098ce6-a4ce-49d7-a8be-8356a6d9eafe None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:45.457672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd098ce6-a4ce-49d7-a8be-8356a6d9eafe None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:45.501977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c8c0e-5c30-478d-a0a7-141d455ddf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:45.502990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c8c0e-5c30-478d-a0a7-141d455ddf3f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:45.503416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c8c0e-5c30-478d-a0a7-141d455ddf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:45.503931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c8c0e-5c30-478d-a0a7-141d455ddf3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:45.519791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c8c0e-5c30-478d-a0a7-141d455ddf3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-162c8c0e-5c30-478d-a0a7-141d455ddf3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:45.526635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:45.527692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:45.528655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:45.534974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 205/397] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:45.540455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67daf6-a216-4939-8dc4-b654d4e652d5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:45.684071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:45.685483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a857-5151-4111-8318-c2bcdb41c5b2 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:45.685771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a857-5151-4111-8318-c2bcdb41c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:45.686052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a857-5151-4111-8318-c2bcdb41c5b2 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:45.688327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 206/398] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:55:45.694405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ade2f-8bbc-44f0-981c-b6be101b2dd8 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:45.694737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ade2f-8bbc-44f0-981c-b6be101b2dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:45.695013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ade2f-8bbc-44f0-981c-b6be101b2dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:45.715725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f37ade2f-8bbc-44f0-981c-b6be101b2dd8 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:45.717402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f37ade2f-8bbc-44f0-981c-b6be101b2dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:45.729846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67daf6-a216-4939-8dc4-b654d4e652d5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:45.733925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:45.793572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf8011-c049-4718-8922-4d3c75f666ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:45.794617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf8011-c049-4718-8922-4d3c75f666ae None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:45.794894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf8011-c049-4718-8922-4d3c75f666ae None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:45.795160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf8011-c049-4718-8922-4d3c75f666ae None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:45.795883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf8011-c049-4718-8922-4d3c75f666ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:45.796180 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf8011-c049-4718-8922-4d3c75f666ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:45.797547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf8011-c049-4718-8922-4d3c75f666ae None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:45.814399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 193/399] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:45.820362 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf8011-c049-4718-8922-4d3c75f666ae None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:45.841579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 207/400] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:45.887295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f609beb-58f6-44cb-91f1-282b531891c7 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:45.887633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f609beb-58f6-44cb-91f1-282b531891c7 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:45.887917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f609beb-58f6-44cb-91f1-282b531891c7 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:45.889387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 208/401] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:45.890171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f609beb-58f6-44cb-91f1-282b531891c7 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:45.968034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf8011-c049-4718-8922-4d3c75f666ae None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:46.013747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c1d8b-62fc-4727-825b-f6073e2ea0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:46.015538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c1d8b-62fc-4727-825b-f6073e2ea0bb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.015538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c1d8b-62fc-4727-825b-f6073e2ea0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.015538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c1d8b-62fc-4727-825b-f6073e2ea0bb None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.016654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c1d8b-62fc-4727-825b-f6073e2ea0bb None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:46.018387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c1d8b-62fc-4727-825b-f6073e2ea0bb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:46.024365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 194/402] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:45 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:46.024365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba463-282b-44dc-9b4a-bfd79cf56eed None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.024365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba463-282b-44dc-9b4a-bfd79cf56eed None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.024365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba463-282b-44dc-9b4a-bfd79cf56eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.042673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f609beb-58f6-44cb-91f1-282b531891c7 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:46.046878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-679ba463-282b-44dc-9b4a-bfd79cf56eed None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:46.048170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-679ba463-282b-44dc-9b4a-bfd79cf56eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:46.050358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:46.090948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095cafd-9ad0-4635-b0d2-5d6a7e1043f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:46.092240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095cafd-9ad0-4635-b0d2-5d6a7e1043f9 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.092726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095cafd-9ad0-4635-b0d2-5d6a7e1043f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.093004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095cafd-9ad0-4635-b0d2-5d6a7e1043f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.108346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095cafd-9ad0-4635-b0d2-5d6a7e1043f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-a095cafd-9ad0-4635-b0d2-5d6a7e1043f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:46.116052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:46.116998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:46.117776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:46.125584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 209/403] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:46.127059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095cafd-9ad0-4635-b0d2-5d6a7e1043f9 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:46.142013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:46.150976 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 195/404] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:46.152132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba463-282b-44dc-9b4a-bfd79cf56eed None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:46.256921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095cafd-9ad0-4635-b0d2-5d6a7e1043f9 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:46.264011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba463-282b-44dc-9b4a-bfd79cf56eed None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:46.297832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce59baa-171a-4b1b-8a2c-4a72d0bc67f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:46.298642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59baa-171a-4b1b-8a2c-4a72d0bc67f8 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.299066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59baa-171a-4b1b-8a2c-4a72d0bc67f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.299433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59baa-171a-4b1b-8a2c-4a72d0bc67f8 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.300707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce59baa-171a-4b1b-8a2c-4a72d0bc67f8 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:46.302267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce59baa-171a-4b1b-8a2c-4a72d0bc67f8 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:46.302469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4a0fe-ab5d-4b09-ad05-eed977accba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:46.303249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a0fe-ab5d-4b09-ad05-eed977accba1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.303684 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a0fe-ab5d-4b09-ad05-eed977accba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.304101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a0fe-ab5d-4b09-ad05-eed977accba1 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.304856 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 210/405] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:46 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:46.305140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4a0fe-ab5d-4b09-ad05-eed977accba1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:46.305595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4a0fe-ab5d-4b09-ad05-eed977accba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:46.306026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce59baa-171a-4b1b-8a2c-4a72d0bc67f8 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:46.307428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4a0fe-ab5d-4b09-ad05-eed977accba1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:46.313067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:46.317808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 196/406] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:46.323509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4a0fe-ab5d-4b09-ad05-eed977accba1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:46.389385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:46.414292 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce59baa-171a-4b1b-8a2c-4a72d0bc67f8 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:46.434087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4a0fe-ab5d-4b09-ad05-eed977accba1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:46.450214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d75d8-1fbc-463f-ac93-780fb092cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:46.450874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d75d8-1fbc-463f-ac93-780fb092cf5d None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.451152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d75d8-1fbc-463f-ac93-780fb092cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.451418 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d75d8-1fbc-463f-ac93-780fb092cf5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.462116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d75d8-1fbc-463f-ac93-780fb092cf5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-7c6d75d8-1fbc-463f-ac93-780fb092cf5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:46.467173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:46.468041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:46.468825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 211/407] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:55:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:46.473994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d75d8-1fbc-463f-ac93-780fb092cf5d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:46.477427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cafaea-41bf-4ca5-a4a4-31c72057522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:46.478547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cafaea-41bf-4ca5-a4a4-31c72057522b None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.479032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cafaea-41bf-4ca5-a4a4-31c72057522b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.479506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cafaea-41bf-4ca5-a4a4-31c72057522b None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.481689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cafaea-41bf-4ca5-a4a4-31c72057522b None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6ca290b26543f7b6f2d6086cfa623a, group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:46.483401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cafaea-41bf-4ca5-a4a4-31c72057522b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:46.501262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 197/408] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Jul 28 01:55:46 2022] PUT /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:46.502530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cafaea-41bf-4ca5-a4a4-31c72057522b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:46.576173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:46.590098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d75d8-1fbc-463f-ac93-780fb092cf5d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:46.627972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bcbac-df5b-419a-8063-b1fd4c026b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:46.628574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bcbac-df5b-419a-8063-b1fd4c026b60 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.628812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bcbac-df5b-419a-8063-b1fd4c026b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.629086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bcbac-df5b-419a-8063-b1fd4c026b60 None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.630349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bcbac-df5b-419a-8063-b1fd4c026b60 None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:46.631540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cafaea-41bf-4ca5-a4a4-31c72057522b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:46.631845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bcbac-df5b-419a-8063-b1fd4c026b60 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:46.633920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 212/409] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:46 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:46.641115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bcbac-df5b-419a-8063-b1fd4c026b60 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:46.645896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:46.690356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ecd07-091a-415f-af23-de8087d7c577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:46.692333 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ecd07-091a-415f-af23-de8087d7c577 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.693017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ecd07-091a-415f-af23-de8087d7c577 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.694632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ecd07-091a-415f-af23-de8087d7c577 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.695617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ecd07-091a-415f-af23-de8087d7c577 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:46.697055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ecd07-091a-415f-af23-de8087d7c577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:46.699570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ecd07-091a-415f-af23-de8087d7c577 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:46.721229 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 198/410] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:46.727973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ecd07-091a-415f-af23-de8087d7c577 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:46.807249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bcbac-df5b-419a-8063-b1fd4c026b60 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:46.868087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ecd07-091a-415f-af23-de8087d7c577 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:46.873789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2c899-b436-4ec2-8aad-b5c146124e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:46.874460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2c899-b436-4ec2-8aad-b5c146124e1c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.874749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2c899-b436-4ec2-8aad-b5c146124e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.875007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2c899-b436-4ec2-8aad-b5c146124e1c None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.877037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2c899-b436-4ec2-8aad-b5c146124e1c None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:46.882854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2c899-b436-4ec2-8aad-b5c146124e1c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:46.884664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 213/411] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:46 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:46.892753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2c899-b436-4ec2-8aad-b5c146124e1c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:46.918889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:46.932977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee1471-543d-4f90-9b23-03956fa1ea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:46.933627 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee1471-543d-4f90-9b23-03956fa1ea74 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.933904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee1471-543d-4f90-9b23-03956fa1ea74 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.934177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee1471-543d-4f90-9b23-03956fa1ea74 None admin] PATH_INFO: `/v3/groups/58aa937cbf084454ae0a708cb1ebc28a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.935414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee1471-543d-4f90-9b23-03956fa1ea74 None admin] RBAC: Authorizing `identity:get_group(group_id=58aa937cbf084454ae0a708cb1ebc28a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:46.936924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee1471-543d-4f90-9b23-03956fa1ea74 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:46.943428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 199/412] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:46 2022] GET /identity/v3/groups/58aa937cbf084454ae0a708cb1ebc28a => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:46.944670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fc57f-301c-4e9a-bd06-55ebe4e73c9b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:46.944953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fc57f-301c-4e9a-bd06-55ebe4e73c9b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:46.945234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fc57f-301c-4e9a-bd06-55ebe4e73c9b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:46.946580 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 200/413] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:46.949801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fc57f-301c-4e9a-bd06-55ebe4e73c9b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:46.991190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:47.024689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2c899-b436-4ec2-8aad-b5c146124e1c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:47.061385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00870531-8c8e-4042-ac93-23714c9a37f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:47.062218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870531-8c8e-4042-ac93-23714c9a37f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:47.062624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870531-8c8e-4042-ac93-23714c9a37f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:47.062998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870531-8c8e-4042-ac93-23714c9a37f8 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4/roles/42afac3d251b45ed822081a66ad20d6d` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:47.065312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00870531-8c8e-4042-ac93-23714c9a37f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b6ca290b26543f7b6f2d6086cfa623a, group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role_id=42afac3d251b45ed822081a66ad20d6d)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:47.067514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00870531-8c8e-4042-ac93-23714c9a37f8 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:47.085762 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 214/414] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Jul 28 01:55:46 2022] PUT /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4/roles/42afac3d251b45ed822081a66ad20d6d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:47.092152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98ebfe-70f0-4b33-b79f-007a434cbd1d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:47.092651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98ebfe-70f0-4b33-b79f-007a434cbd1d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:47.093113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98ebfe-70f0-4b33-b79f-007a434cbd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:47.095425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fc57f-301c-4e9a-bd06-55ebe4e73c9b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:47.133117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9e98ebfe-70f0-4b33-b79f-007a434cbd1d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:47.137451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9e98ebfe-70f0-4b33-b79f-007a434cbd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:47.168500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df124059-2aea-44e6-aff6-602491daf42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:47.170940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df124059-2aea-44e6-aff6-602491daf42f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:47.170940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df124059-2aea-44e6-aff6-602491daf42f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:47.170940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df124059-2aea-44e6-aff6-602491daf42f None admin] PATH_INFO: `/v3/projects/610fee5f9cbd481ca2b8410c0ec0c0c0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:47.171194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df124059-2aea-44e6-aff6-602491daf42f None admin] RBAC: Authorizing `identity:get_project(project_id=610fee5f9cbd481ca2b8410c0ec0c0c0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:47.179354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df124059-2aea-44e6-aff6-602491daf42f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:47.186466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 201/415] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:46 2022] GET /identity/v3/projects/610fee5f9cbd481ca2b8410c0ec0c0c0 => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:47.198553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df124059-2aea-44e6-aff6-602491daf42f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:47.252891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 215/416] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:47.278621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:47.295644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98ebfe-70f0-4b33-b79f-007a434cbd1d None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:47.343037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df124059-2aea-44e6-aff6-602491daf42f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:47.372117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:47.389855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d11df-c74b-452d-870a-bfd3537a86f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:47.390480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d11df-c74b-452d-870a-bfd3537a86f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:47.390767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d11df-c74b-452d-870a-bfd3537a86f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:47.391041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d11df-c74b-452d-870a-bfd3537a86f9 None admin] PATH_INFO: `/v3/projects/610fee5f9cbd481ca2b8410c0ec0c0c0/groups/58aa937cbf084454ae0a708cb1ebc28a/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:47.393065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d11df-c74b-452d-870a-bfd3537a86f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=610fee5f9cbd481ca2b8410c0ec0c0c0, group_id=58aa937cbf084454ae0a708cb1ebc28a, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:47.395248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d11df-c74b-452d-870a-bfd3537a86f9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:47.422123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 202/417] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Jul 28 01:55:47 2022] PUT /identity/v3/projects/610fee5f9cbd481ca2b8410c0ec0c0c0/groups/58aa937cbf084454ae0a708cb1ebc28a/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:55:47.447178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98ebfe-70f0-4b33-b79f-007a434cbd1d None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:47.508810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ac20c-c932-4698-85e0-02e1d0a5bd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:47.509505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ac20c-c932-4698-85e0-02e1d0a5bd7e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:47.509785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ac20c-c932-4698-85e0-02e1d0a5bd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:47.510053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ac20c-c932-4698-85e0-02e1d0a5bd7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:47.531040 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ac20c-c932-4698-85e0-02e1d0a5bd7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-546ac20c-c932-4698-85e0-02e1d0a5bd7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:47.536148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:47.537051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:47.537818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 216/418] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:47.545249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d11df-c74b-452d-870a-bfd3537a86f9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:47.545798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a358-410d-41d9-9a24-84be5ad62df9 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:47.546088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a358-410d-41d9-9a24-84be5ad62df9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:47.546364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a358-410d-41d9-9a24-84be5ad62df9 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:47.548171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 217/419] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:47.553897 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff992-5f4f-4ba0-9acd-7b1a3b6681a9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:47.554214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff992-5f4f-4ba0-9acd-7b1a3b6681a9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:47.554474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff992-5f4f-4ba0-9acd-7b1a3b6681a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:47.574776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-47fff992-5f4f-4ba0-9acd-7b1a3b6681a9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:47.576081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-47fff992-5f4f-4ba0-9acd-7b1a3b6681a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:47.671314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 218/420] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:47.708914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff992-5f4f-4ba0-9acd-7b1a3b6681a9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:47.718918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d11df-c74b-452d-870a-bfd3537a86f9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:47.767864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:47.779109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:47.814462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9efd8-e6fa-489b-8a01-d7631a33f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:47.814462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9efd8-e6fa-489b-8a01-d7631a33f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:47.814462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9efd8-e6fa-489b-8a01-d7631a33f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:47.814462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9efd8-e6fa-489b-8a01-d7631a33f6d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:47.814866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9efd8-e6fa-489b-8a01-d7631a33f6d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:47.814866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9efd8-e6fa-489b-8a01-d7631a33f6d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:47.814866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9efd8-e6fa-489b-8a01-d7631a33f6d7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:47.823763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 203/421] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:47.830459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9efd8-e6fa-489b-8a01-d7631a33f6d7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:47.859192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff992-5f4f-4ba0-9acd-7b1a3b6681a9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:47.900700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f47261-6e0a-4a1f-9531-c98a6e5ec017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:47.901374 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47261-6e0a-4a1f-9531-c98a6e5ec017 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:47.901623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47261-6e0a-4a1f-9531-c98a6e5ec017 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:47.901897 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47261-6e0a-4a1f-9531-c98a6e5ec017 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:47.928264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f47261-6e0a-4a1f-9531-c98a6e5ec017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-10f47261-6e0a-4a1f-9531-c98a6e5ec017 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:47.936288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:47.937189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:47.937996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 219/422] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:47.945143 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f47261-6e0a-4a1f-9531-c98a6e5ec017 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:48.066653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f47261-6e0a-4a1f-9531-c98a6e5ec017 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:48.081817 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:48.087810 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9efd8-e6fa-489b-8a01-d7631a33f6d7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:48.109534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cbc3c-bb86-4dc4-ae63-8c1f4287acc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:48.110160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cbc3c-bb86-4dc4-ae63-8c1f4287acc5 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:48.110454 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cbc3c-bb86-4dc4-ae63-8c1f4287acc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:48.110740 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cbc3c-bb86-4dc4-ae63-8c1f4287acc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:48.113490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cbc3c-bb86-4dc4-ae63-8c1f4287acc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:48.113798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cbc3c-bb86-4dc4-ae63-8c1f4287acc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:48.115239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cbc3c-bb86-4dc4-ae63-8c1f4287acc5 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:48.138676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 220/423] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:48.139236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4dfcd-a176-4be7-b38e-21344c15a0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:48.139864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4dfcd-a176-4be7-b38e-21344c15a0dc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:48.140139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4dfcd-a176-4be7-b38e-21344c15a0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:48.140406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4dfcd-a176-4be7-b38e-21344c15a0dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:48.143934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cbc3c-bb86-4dc4-ae63-8c1f4287acc5 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:48.214550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:48.252583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4dfcd-a176-4be7-b38e-21344c15a0dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:48.254054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4dfcd-a176-4be7-b38e-21344c15a0dc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:48.323531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cbc3c-bb86-4dc4-ae63-8c1f4287acc5 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:48.365758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614670e3-df56-4c44-a488-6366038517fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:48.366812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614670e3-df56-4c44-a488-6366038517fe None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:48.367286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614670e3-df56-4c44-a488-6366038517fe None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:48.367774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614670e3-df56-4c44-a488-6366038517fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:48.425342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 204/424] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 01:55:48.431740 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4dfcd-a176-4be7-b38e-21344c15a0dc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:48.451109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:48.520260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614670e3-df56-4c44-a488-6366038517fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:48.520952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614670e3-df56-4c44-a488-6366038517fe None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:48.532742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:48.566926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4dfcd-a176-4be7-b38e-21344c15a0dc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:48.653110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d03c-6751-4255-8e86-26af7ffab124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:48.654910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d03c-6751-4255-8e86-26af7ffab124 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:48.657072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d03c-6751-4255-8e86-26af7ffab124 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:48.657588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d03c-6751-4255-8e86-26af7ffab124 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:48.659028 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963d03c-6751-4255-8e86-26af7ffab124 None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:48.661831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963d03c-6751-4255-8e86-26af7ffab124 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:48.666021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 205/425] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:48 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:48.671524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d03c-6751-4255-8e86-26af7ffab124 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:48.698472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 221/426] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:48.707006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614670e3-df56-4c44-a488-6366038517fe None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:48.811332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:48.848947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614670e3-df56-4c44-a488-6366038517fe None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:48.892989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d03c-6751-4255-8e86-26af7ffab124 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:48.918408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d67d7-e562-46a7-9802-77d2326dd086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:48.919073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d67d7-e562-46a7-9802-77d2326dd086 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:48.919352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d67d7-e562-46a7-9802-77d2326dd086 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:48.919628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d67d7-e562-46a7-9802-77d2326dd086 None admin] PATH_INFO: `/v3/projects/9874927d1bb641cba1df1d9d5a436cd5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:48.920899 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d67d7-e562-46a7-9802-77d2326dd086 None admin] RBAC: Authorizing `identity:get_project(project_id=9874927d1bb641cba1df1d9d5a436cd5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:48.922362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d67d7-e562-46a7-9802-77d2326dd086 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:48.933192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 222/427] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:48 2022] GET /identity/v3/projects/9874927d1bb641cba1df1d9d5a436cd5 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:48.934075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d67d7-e562-46a7-9802-77d2326dd086 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:48.967525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaac3f7-04ca-4466-afc8-bd2ccf52b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:48.968182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaac3f7-04ca-4466-afc8-bd2ccf52b016 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:48.968459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaac3f7-04ca-4466-afc8-bd2ccf52b016 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:48.968734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaac3f7-04ca-4466-afc8-bd2ccf52b016 None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:48.971167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaac3f7-04ca-4466-afc8-bd2ccf52b016 None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:48.972615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaac3f7-04ca-4466-afc8-bd2ccf52b016 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:48.982851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 206/428] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:48 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:48.990083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaac3f7-04ca-4466-afc8-bd2ccf52b016 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:49.013350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:49.071218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d67d7-e562-46a7-9802-77d2326dd086 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:49.114846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaac3f7-04ca-4466-afc8-bd2ccf52b016 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:49.120337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05445ed8-5933-4324-84c1-eb3256d2c4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:49.120984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445ed8-5933-4324-84c1-eb3256d2c4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.121265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445ed8-5933-4324-84c1-eb3256d2c4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.121540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445ed8-5933-4324-84c1-eb3256d2c4f7 None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.122775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05445ed8-5933-4324-84c1-eb3256d2c4f7 None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:49.124877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05445ed8-5933-4324-84c1-eb3256d2c4f7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:49.130541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 223/429] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:48 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:49.131779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbc41a-c47c-4d19-9d01-ac1ad946d534 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.132052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbc41a-c47c-4d19-9d01-ac1ad946d534 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.132411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbc41a-c47c-4d19-9d01-ac1ad946d534 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.133690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 224/430] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:49.134659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbc41a-c47c-4d19-9d01-ac1ad946d534 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:49.153217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:49.170526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70530994-ae24-4a96-947e-d725cb36836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:49.171498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70530994-ae24-4a96-947e-d725cb36836f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.172212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70530994-ae24-4a96-947e-d725cb36836f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.173020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70530994-ae24-4a96-947e-d725cb36836f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.174100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70530994-ae24-4a96-947e-d725cb36836f None admin] RBAC: Adding query filter params (group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role.id=42afac3d251b45ed822081a66ad20d6d, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:49.174590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70530994-ae24-4a96-947e-d725cb36836f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:49.176796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70530994-ae24-4a96-947e-d725cb36836f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:49.191523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 207/431] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jul 28 01:55:48 2022] GET /identity/v3/role_assignments?group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=42afac3d251b45ed822081a66ad20d6d => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:49.191523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a12096-0186-4390-afeb-992f21aa158d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.191523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a12096-0186-4390-afeb-992f21aa158d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.191523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a12096-0186-4390-afeb-992f21aa158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.227315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d5a12096-0186-4390-afeb-992f21aa158d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:49.229210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d5a12096-0186-4390-afeb-992f21aa158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:49.314966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbc41a-c47c-4d19-9d01-ac1ad946d534 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:49.377464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 208/432] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:49.382629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1a362-68bd-469a-8b10-4835ff0f78a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:49.383417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1a362-68bd-469a-8b10-4835ff0f78a5 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.383865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1a362-68bd-469a-8b10-4835ff0f78a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.384296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1a362-68bd-469a-8b10-4835ff0f78a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.385219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1a362-68bd-469a-8b10-4835ff0f78a5 None admin] RBAC: Adding query filter params (group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role.id=55fc2032ca914d2fb1ec5cbd52f60e54, scope.project.id=9874927d1bb641cba1df1d9d5a436cd5) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:49.385674 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1a362-68bd-469a-8b10-4835ff0f78a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:49.387324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1a362-68bd-469a-8b10-4835ff0f78a5 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:49.393928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 225/433] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jul 28 01:55:49 2022] GET /identity/v3/role_assignments?group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4&scope.project.id=9874927d1bb641cba1df1d9d5a436cd5&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:49.399661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42002e-9038-4db6-a65c-5318fef42d06 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.400168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42002e-9038-4db6-a65c-5318fef42d06 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.400583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42002e-9038-4db6-a65c-5318fef42d06 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.402714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 209/434] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:55:49.407974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b012a6-7252-45c5-9c6d-e38e08b50d56 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.408524 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b012a6-7252-45c5-9c6d-e38e08b50d56 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.408958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b012a6-7252-45c5-9c6d-e38e08b50d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.413442 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42002e-9038-4db6-a65c-5318fef42d06 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:49.429195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:49.433749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e5b012a6-7252-45c5-9c6d-e38e08b50d56 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:49.435227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e5b012a6-7252-45c5-9c6d-e38e08b50d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:49.522722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 226/435] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:49.543609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42002e-9038-4db6-a65c-5318fef42d06 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:49.547668 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b012a6-7252-45c5-9c6d-e38e08b50d56 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:49.551235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:49.593453 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec40676-6691-4e7f-8b25-6eac72a7e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:49.594105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec40676-6691-4e7f-8b25-6eac72a7e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.594381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec40676-6691-4e7f-8b25-6eac72a7e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.594683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec40676-6691-4e7f-8b25-6eac72a7e6a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.609768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec40676-6691-4e7f-8b25-6eac72a7e6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4ec40676-6691-4e7f-8b25-6eac72a7e6a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:49.614993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:49.615958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 01:55:49.616741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:49.626576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 210/436] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:49.631907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec40676-6691-4e7f-8b25-6eac72a7e6a3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:49.680119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b012a6-7252-45c5-9c6d-e38e08b50d56 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:49.710893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:49.729499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2d44b-de67-435f-8335-c07f6f5b8824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:49.730145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2d44b-de67-435f-8335-c07f6f5b8824 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.730425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2d44b-de67-435f-8335-c07f6f5b8824 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.730722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2d44b-de67-435f-8335-c07f6f5b8824 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.743144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2d44b-de67-435f-8335-c07f6f5b8824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-a9f2d44b-de67-435f-8335-c07f6f5b8824 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:49.748161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:49.749062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:49.750725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 227/437] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:49.755273 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5c29-39b6-4e5d-9edf-7a44619c9e94 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.755562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5c29-39b6-4e5d-9edf-7a44619c9e94 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.755841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5c29-39b6-4e5d-9edf-7a44619c9e94 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.757151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 228/438] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:49.757369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec40676-6691-4e7f-8b25-6eac72a7e6a3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:49.757873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5c29-39b6-4e5d-9edf-7a44619c9e94 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:49.798391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d6f6e-520d-4272-8771-48abd479a572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:49.799047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d6f6e-520d-4272-8771-48abd479a572 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.799323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d6f6e-520d-4272-8771-48abd479a572 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.799595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d6f6e-520d-4272-8771-48abd479a572 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.800331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d6f6e-520d-4272-8771-48abd479a572 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:49.800595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d6f6e-520d-4272-8771-48abd479a572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:49.801965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d6f6e-520d-4272-8771-48abd479a572 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:49.812625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 211/439] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:55:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:49.813754 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2c68d-1fee-47b8-8e73-3ec623638354 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.814040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2c68d-1fee-47b8-8e73-3ec623638354 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.814314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2c68d-1fee-47b8-8e73-3ec623638354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.833524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7fb2c68d-1fee-47b8-8e73-3ec623638354 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:49.834747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7fb2c68d-1fee-47b8-8e73-3ec623638354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:49.843565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:49.895170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5c29-39b6-4e5d-9edf-7a44619c9e94 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:49.921271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 212/440] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:49.922399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2c68d-1fee-47b8-8e73-3ec623638354 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:49.947902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a30ad-cf50-4885-858a-83922f638b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:49.949071 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a30ad-cf50-4885-858a-83922f638b8d None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:49.949535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a30ad-cf50-4885-858a-83922f638b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:49.949806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a30ad-cf50-4885-858a-83922f638b8d None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:49.950660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a30ad-cf50-4885-858a-83922f638b8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:49.950962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a30ad-cf50-4885-858a-83922f638b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:49.952388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a30ad-cf50-4885-858a-83922f638b8d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:49.962024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 229/441] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:49.963376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a30ad-cf50-4885-858a-83922f638b8d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:49.999972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:50.048059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2c68d-1fee-47b8-8e73-3ec623638354 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:50.073447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a30ad-cf50-4885-858a-83922f638b8d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:50.083088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d93dce-b773-4604-a500-b347b71f1164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:50.083710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d93dce-b773-4604-a500-b347b71f1164 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:50.083987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d93dce-b773-4604-a500-b347b71f1164 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:50.084258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d93dce-b773-4604-a500-b347b71f1164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:50.098718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:50.107684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a11d7-7ce8-49ae-9aeb-6da7c8058b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:50.108309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a11d7-7ce8-49ae-9aeb-6da7c8058b85 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:50.108586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a11d7-7ce8-49ae-9aeb-6da7c8058b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:50.108858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a11d7-7ce8-49ae-9aeb-6da7c8058b85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:50.118713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a11d7-7ce8-49ae-9aeb-6da7c8058b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-e52a11d7-7ce8-49ae-9aeb-6da7c8058b85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:50.126819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:50.127732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:50.128527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 230/442] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:55:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:50.129400 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a11d7-7ce8-49ae-9aeb-6da7c8058b85 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:50.156480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d93dce-b773-4604-a500-b347b71f1164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:50.157849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d93dce-b773-4604-a500-b347b71f1164 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:50.216923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:50.247591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a11d7-7ce8-49ae-9aeb-6da7c8058b85 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:50.256308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 213/443] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:50.257127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d93dce-b773-4604-a500-b347b71f1164 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:50.291000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d20fd6-c083-4283-b1f6-28ed5ddbcc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:50.291814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d20fd6-c083-4283-b1f6-28ed5ddbcc6c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:50.292263 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d20fd6-c083-4283-b1f6-28ed5ddbcc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:50.292704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d20fd6-c083-4283-b1f6-28ed5ddbcc6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:50.352730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d93dce-b773-4604-a500-b347b71f1164 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:50.357358 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:50.374588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d20fd6-c083-4283-b1f6-28ed5ddbcc6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:50.376567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d20fd6-c083-4283-b1f6-28ed5ddbcc6c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:50.386199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07982c-9e4e-4688-ae53-ddf8fb81191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:50.386841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07982c-9e4e-4688-ae53-ddf8fb81191e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:50.387117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07982c-9e4e-4688-ae53-ddf8fb81191e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:50.387413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07982c-9e4e-4688-ae53-ddf8fb81191e None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:50.388123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07982c-9e4e-4688-ae53-ddf8fb81191e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:50.388419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07982c-9e4e-4688-ae53-ddf8fb81191e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:50.389764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07982c-9e4e-4688-ae53-ddf8fb81191e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:50.397642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 214/444] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:50.398408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07982c-9e4e-4688-ae53-ddf8fb81191e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:50.424287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:50.492413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 231/445] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:50.494258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d20fd6-c083-4283-b1f6-28ed5ddbcc6c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:50.497384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07982c-9e4e-4688-ae53-ddf8fb81191e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:50.531266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9c500-1310-4a7a-b3e3-a4b4c76f42a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:50.531898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c500-1310-4a7a-b3e3-a4b4c76f42a0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:50.532180 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c500-1310-4a7a-b3e3-a4b4c76f42a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:50.532462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c500-1310-4a7a-b3e3-a4b4c76f42a0 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:50.533619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9c500-1310-4a7a-b3e3-a4b4c76f42a0 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:50.535103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9c500-1310-4a7a-b3e3-a4b4c76f42a0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:50.536753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 215/446] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:50 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:50.537499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9c500-1310-4a7a-b3e3-a4b4c76f42a0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:50.596517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:50.615316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d20fd6-c083-4283-b1f6-28ed5ddbcc6c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:50.629660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:50.638338 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9c500-1310-4a7a-b3e3-a4b4c76f42a0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:50.657347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80462bf-1c79-4dab-b447-46bb4bd58a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:50.658327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80462bf-1c79-4dab-b447-46bb4bd58a41 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:50.658803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80462bf-1c79-4dab-b447-46bb4bd58a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:50.659238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80462bf-1c79-4dab-b447-46bb4bd58a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:50.678743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bde79-56e8-45a5-bc04-6a8327f63068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:50.679305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bde79-56e8-45a5-bc04-6a8327f63068 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:50.679582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bde79-56e8-45a5-bc04-6a8327f63068 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:50.679849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bde79-56e8-45a5-bc04-6a8327f63068 None admin] PATH_INFO: `/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:50.681542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bde79-56e8-45a5-bc04-6a8327f63068 None admin] RBAC: Authorizing `identity:get_project(project_id=1b6ca290b26543f7b6f2d6086cfa623a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:50.683081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bde79-56e8-45a5-bc04-6a8327f63068 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:50.684722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 216/447] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:50 2022] GET /identity/v3/projects/1b6ca290b26543f7b6f2d6086cfa623a => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:50.685468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bde79-56e8-45a5-bc04-6a8327f63068 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:50.737449 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80462bf-1c79-4dab-b447-46bb4bd58a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:50.738939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80462bf-1c79-4dab-b447-46bb4bd58a41 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:50.785199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bde79-56e8-45a5-bc04-6a8327f63068 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:50.818250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32985b-ad3c-44fe-8309-f8d6a006ccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:50.818918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32985b-ad3c-44fe-8309-f8d6a006ccb9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:50.819200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32985b-ad3c-44fe-8309-f8d6a006ccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:50.819463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32985b-ad3c-44fe-8309-f8d6a006ccb9 None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:50.820133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:50.820606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32985b-ad3c-44fe-8309-f8d6a006ccb9 None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:50.822061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32985b-ad3c-44fe-8309-f8d6a006ccb9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:50.823670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 217/448] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:50 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:50.824414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32985b-ad3c-44fe-8309-f8d6a006ccb9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:50.840898 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 232/449] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:50.841814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80462bf-1c79-4dab-b447-46bb4bd58a41 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:50.852374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:50.923844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32985b-ad3c-44fe-8309-f8d6a006ccb9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:50.943660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80462bf-1c79-4dab-b447-46bb4bd58a41 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:50.958959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06737a06-f823-4d05-b0fc-2594518b504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:50.959596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06737a06-f823-4d05-b0fc-2594518b504d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:50.959873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06737a06-f823-4d05-b0fc-2594518b504d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:50.960148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06737a06-f823-4d05-b0fc-2594518b504d None admin] PATH_INFO: `/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:50.961297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06737a06-f823-4d05-b0fc-2594518b504d None admin] RBAC: Authorizing `identity:get_group(group_id=9d97ca43665c4d2f9bfd3b01f27bdbe4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:50.963302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06737a06-f823-4d05-b0fc-2594518b504d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:50.964916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 218/450] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:50 2022] GET /identity/v3/groups/9d97ca43665c4d2f9bfd3b01f27bdbe4 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:50.965655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06737a06-f823-4d05-b0fc-2594518b504d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:50.977577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca9e17-b038-4d67-802c-bb2e81e7c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:50.978754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9e17-b038-4d67-802c-bb2e81e7c340 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:50.979038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9e17-b038-4d67-802c-bb2e81e7c340 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:50.979312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9e17-b038-4d67-802c-bb2e81e7c340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:50.980108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca9e17-b038-4d67-802c-bb2e81e7c340 None admin] RBAC: Adding query filter params (group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role.id=55fc2032ca914d2fb1ec5cbd52f60e54, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:50.980418 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca9e17-b038-4d67-802c-bb2e81e7c340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:50.981883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca9e17-b038-4d67-802c-bb2e81e7c340 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:50.987523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 233/451] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jul 28 01:55:50 2022] GET /identity/v3/role_assignments?group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=55fc2032ca914d2fb1ec5cbd52f60e54 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:50.988359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca9e17-b038-4d67-802c-bb2e81e7c340 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:51.046663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:51.085901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:51.093188 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06737a06-f823-4d05-b0fc-2594518b504d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:51.108679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca9e17-b038-4d67-802c-bb2e81e7c340 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:51.129548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3860e-dc82-412a-bda7-4572838658f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:51.130205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3860e-dc82-412a-bda7-4572838658f7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:51.130507 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3860e-dc82-412a-bda7-4572838658f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:51.130785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3860e-dc82-412a-bda7-4572838658f7 None admin] PATH_INFO: `/v3/projects/610fee5f9cbd481ca2b8410c0ec0c0c0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:51.132003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3860e-dc82-412a-bda7-4572838658f7 None admin] RBAC: Authorizing `identity:get_project(project_id=610fee5f9cbd481ca2b8410c0ec0c0c0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:51.133474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3860e-dc82-412a-bda7-4572838658f7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:51.135293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 219/452] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:55:50 2022] GET /identity/v3/projects/610fee5f9cbd481ca2b8410c0ec0c0c0 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:51.140998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3860e-dc82-412a-bda7-4572838658f7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:51.149169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5001e-5894-46ae-a42c-123d7912a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:51.150555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5001e-5894-46ae-a42c-123d7912a254 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:51.151037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5001e-5894-46ae-a42c-123d7912a254 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:51.151311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5001e-5894-46ae-a42c-123d7912a254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:51.152120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5001e-5894-46ae-a42c-123d7912a254 None admin] RBAC: Adding query filter params (group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4, role.id=42afac3d251b45ed822081a66ad20d6d, scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:51.152424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5001e-5894-46ae-a42c-123d7912a254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:51.153880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5001e-5894-46ae-a42c-123d7912a254 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:51.159931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 234/453] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jul 28 01:55:50 2022] GET /identity/v3/role_assignments?group.id=9d97ca43665c4d2f9bfd3b01f27bdbe4&scope.project.id=1b6ca290b26543f7b6f2d6086cfa623a&role.id=42afac3d251b45ed822081a66ad20d6d => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:51.263830 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3860e-dc82-412a-bda7-4572838658f7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:51.301381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff301c41-7963-4793-b9f7-33f4d053773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:51.302043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff301c41-7963-4793-b9f7-33f4d053773a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:51.302327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff301c41-7963-4793-b9f7-33f4d053773a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:51.302633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff301c41-7963-4793-b9f7-33f4d053773a None admin] PATH_INFO: `/v3/groups/58aa937cbf084454ae0a708cb1ebc28a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:51.303860 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff301c41-7963-4793-b9f7-33f4d053773a None admin] RBAC: Authorizing `identity:get_group(group_id=58aa937cbf084454ae0a708cb1ebc28a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:51.305318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff301c41-7963-4793-b9f7-33f4d053773a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:51.307180 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 220/454] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Jul 28 01:55:51 2022] GET /identity/v3/groups/58aa937cbf084454ae0a708cb1ebc28a => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:51.313020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5001e-5894-46ae-a42c-123d7912a254 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:51.422672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5001e-5894-46ae-a42c-123d7912a254 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:51.436475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:51.457728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b03a1a-2643-4b3a-a111-019b20648046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:51.458338 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03a1a-2643-4b3a-a111-019b20648046 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:51.458648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03a1a-2643-4b3a-a111-019b20648046 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:51.458923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03a1a-2643-4b3a-a111-019b20648046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:51.459713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b03a1a-2643-4b3a-a111-019b20648046 None admin] RBAC: Adding query filter params (group.id=58aa937cbf084454ae0a708cb1ebc28a, role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=610fee5f9cbd481ca2b8410c0ec0c0c0) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:51.460022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b03a1a-2643-4b3a-a111-019b20648046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:51.461456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b03a1a-2643-4b3a-a111-019b20648046 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:51.467958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 235/455] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Jul 28 01:55:51 2022] GET /identity/v3/role_assignments?group.id=58aa937cbf084454ae0a708cb1ebc28a&scope.project.id=610fee5f9cbd481ca2b8410c0ec0c0c0&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:53.915314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc6ac-a316-4ea1-9353-9a627f0c50e2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:53.916240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc6ac-a316-4ea1-9353-9a627f0c50e2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:53.916747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc6ac-a316-4ea1-9353-9a627f0c50e2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:53.918574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 221/456] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:53.936436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7339d5-01f6-46e5-8fcc-455dde8290d3 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:53.936895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7339d5-01f6-46e5-8fcc-455dde8290d3 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:53.936994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7339d5-01f6-46e5-8fcc-455dde8290d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:53.959485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-5e7339d5-01f6-46e5-8fcc-455dde8290d3 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:53.960706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-5e7339d5-01f6-46e5-8fcc-455dde8290d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:54.052737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 236/457] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:54.091997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dc6ac-a316-4ea1-9353-9a627f0c50e2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:54.101357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b2a36-bf5d-4215-b0af-746c1083c62f None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.101671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b2a36-bf5d-4215-b0af-746c1083c62f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.101914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b2a36-bf5d-4215-b0af-746c1083c62f None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.103550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 237/458] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:54.109283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c488a2-72d7-46f0-85b2-2a59fa214027 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.109596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c488a2-72d7-46f0-85b2-2a59fa214027 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.109834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c488a2-72d7-46f0-85b2-2a59fa214027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.134954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-98c488a2-72d7-46f0-85b2-2a59fa214027 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:54.136953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-98c488a2-72d7-46f0-85b2-2a59fa214027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:54.138763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:54.264130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dc6ac-a316-4ea1-9353-9a627f0c50e2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:54.276878 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 238/459] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:54.309082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c488a2-72d7-46f0-85b2-2a59fa214027 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:54.317234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93d88d-110e-436f-af01-876896d8454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:54.317881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d88d-110e-436f-af01-876896d8454f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.318146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d88d-110e-436f-af01-876896d8454f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.318415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d88d-110e-436f-af01-876896d8454f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.338043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93d88d-110e-436f-af01-876896d8454f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:54.339517 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93d88d-110e-436f-af01-876896d8454f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:54.354791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7e93d88d-110e-436f-af01-876896d8454f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:55:54.367905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:54.369421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:54.370257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:55:54.370257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:55:54.370257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:54.370257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:54.376946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 222/460] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:54.378341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93d88d-110e-436f-af01-876896d8454f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:54.440956 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c488a2-72d7-46f0-85b2-2a59fa214027 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:54.476997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137dac2-9cd2-4023-95c2-10a0f6df975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:54.478622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137dac2-9cd2-4023-95c2-10a0f6df975c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.479131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137dac2-9cd2-4023-95c2-10a0f6df975c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.479640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137dac2-9cd2-4023-95c2-10a0f6df975c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.482267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:54.491871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137dac2-9cd2-4023-95c2-10a0f6df975c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:54.494322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137dac2-9cd2-4023-95c2-10a0f6df975c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:54.499869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93d88d-110e-436f-af01-876896d8454f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-4137dac2-9cd2-4023-95c2-10a0f6df975c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:55:54.510404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:54.511265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:54.512097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:55:54.512097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:55:54.512097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:54.512097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:54.514469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 239/461] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:54.515979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d294e5-a900-4a1e-802d-a3cc27e6d629 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.516455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d294e5-a900-4a1e-802d-a3cc27e6d629 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.516935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d294e5-a900-4a1e-802d-a3cc27e6d629 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.518648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 240/462] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:54.527392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d294e5-a900-4a1e-802d-a3cc27e6d629 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:54.542024 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187277c-0a80-4dc2-87be-de382cff516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:54.542766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187277c-0a80-4dc2-87be-de382cff516d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.543049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187277c-0a80-4dc2-87be-de382cff516d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.543321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187277c-0a80-4dc2-87be-de382cff516d None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.544016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187277c-0a80-4dc2-87be-de382cff516d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:54.544315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187277c-0a80-4dc2-87be-de382cff516d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:54.545685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187277c-0a80-4dc2-87be-de382cff516d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:54.563680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 223/463] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:54.563680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a196e-212e-40e1-8894-5e1fc3fed7b9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.563680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a196e-212e-40e1-8894-5e1fc3fed7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.563680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a196e-212e-40e1-8894-5e1fc3fed7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.580485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-914a196e-212e-40e1-8894-5e1fc3fed7b9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:54.581780 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-914a196e-212e-40e1-8894-5e1fc3fed7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:54.631448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:54.644422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d294e5-a900-4a1e-802d-a3cc27e6d629 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:54.662472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 224/464] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:54.662472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a196e-212e-40e1-8894-5e1fc3fed7b9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:54.704834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316ca3f-43ce-4480-a77a-da8e5be1f0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:54.705912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316ca3f-43ce-4480-a77a-da8e5be1f0cd None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.706386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316ca3f-43ce-4480-a77a-da8e5be1f0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.706887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316ca3f-43ce-4480-a77a-da8e5be1f0cd None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.707893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316ca3f-43ce-4480-a77a-da8e5be1f0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:54.708388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316ca3f-43ce-4480-a77a-da8e5be1f0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:54.710015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316ca3f-43ce-4480-a77a-da8e5be1f0cd None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:54.723668 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 241/465] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:54.724917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316ca3f-43ce-4480-a77a-da8e5be1f0cd None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:54.744625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:54.771998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a196e-212e-40e1-8894-5e1fc3fed7b9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:54.808821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a77cb-6629-40fd-8522-94872a10883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:54.809443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a77cb-6629-40fd-8522-94872a10883c None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.809718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a77cb-6629-40fd-8522-94872a10883c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.809987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a77cb-6629-40fd-8522-94872a10883c None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.810683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a77cb-6629-40fd-8522-94872a10883c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:54.812117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a77cb-6629-40fd-8522-94872a10883c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:54.834489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 225/466] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:54 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:54.834489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a77cb-6629-40fd-8522-94872a10883c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:54.861334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316ca3f-43ce-4480-a77a-da8e5be1f0cd None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:54.903326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cebe1-d612-4ae3-8321-64c13ed38d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:54.904353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cebe1-d612-4ae3-8321-64c13ed38d07 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.904771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cebe1-d612-4ae3-8321-64c13ed38d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.905182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cebe1-d612-4ae3-8321-64c13ed38d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.918620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cebe1-d612-4ae3-8321-64c13ed38d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:54.920430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cebe1-d612-4ae3-8321-64c13ed38d07 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-dd2cebe1-d612-4ae3-8321-64c13ed38d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:55:54.938054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:54.939584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:54.940497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:55:54.940497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:55:54.940497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:54.940497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:54.942763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 242/467] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:54.944434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7b95e-0157-49a1-9473-c48d1155f6e2 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:54.944973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7b95e-0157-49a1-9473-c48d1155f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:54.945437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7b95e-0157-49a1-9473-c48d1155f6e2 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:54.947202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 243/468] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:54.948552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7b95e-0157-49a1-9473-c48d1155f6e2 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:54.953793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:54.985509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a77cb-6629-40fd-8522-94872a10883c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:55.020139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:55.036291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff09431-75cd-4e8f-9dd2-5b30f9a33420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:55.036917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09431-75cd-4e8f-9dd2-5b30f9a33420 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.037193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09431-75cd-4e8f-9dd2-5b30f9a33420 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.037461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09431-75cd-4e8f-9dd2-5b30f9a33420 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.038141 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff09431-75cd-4e8f-9dd2-5b30f9a33420 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:55.039624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff09431-75cd-4e8f-9dd2-5b30f9a33420 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:55.067399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 226/469] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:54 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:55.068780 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19e52f-aa9b-4864-8624-8c48e96c7a46 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.069074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19e52f-aa9b-4864-8624-8c48e96c7a46 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.069355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19e52f-aa9b-4864-8624-8c48e96c7a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.090902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7b95e-0157-49a1-9473-c48d1155f6e2 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:55.091379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3e19e52f-aa9b-4864-8624-8c48e96c7a46 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:55.093407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3e19e52f-aa9b-4864-8624-8c48e96c7a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:55.140354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07635b2a-f0bb-4119-b8c7-d80f5868ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:55.141332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07635b2a-f0bb-4119-b8c7-d80f5868ae45 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.141790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07635b2a-f0bb-4119-b8c7-d80f5868ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.142239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07635b2a-f0bb-4119-b8c7-d80f5868ae45 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.143929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07635b2a-f0bb-4119-b8c7-d80f5868ae45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:55.144432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07635b2a-f0bb-4119-b8c7-d80f5868ae45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:55.146600 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07635b2a-f0bb-4119-b8c7-d80f5868ae45 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:55.164556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 244/470] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:55.166812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f322d-e197-4fbd-9109-c3b9cb5eae4e None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.167326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f322d-e197-4fbd-9109-c3b9cb5eae4e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.167791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f322d-e197-4fbd-9109-c3b9cb5eae4e None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.170062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 245/471] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:55.174771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f322d-e197-4fbd-9109-c3b9cb5eae4e None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:55.186587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 227/472] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:55.188761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a16f6-b3a3-4847-9a10-940b7c85015c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.189702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a16f6-b3a3-4847-9a10-940b7c85015c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.190325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a16f6-b3a3-4847-9a10-940b7c85015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.215641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-230a16f6-b3a3-4847-9a10-940b7c85015c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:55.217432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-230a16f6-b3a3-4847-9a10-940b7c85015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:55.249331 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:55.304178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f322d-e197-4fbd-9109-c3b9cb5eae4e None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:55.311351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 228/473] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:55.312645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a16f6-b3a3-4847-9a10-940b7c85015c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:55.345503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa905fd-0901-4374-98c1-1f308dd6d0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:55.346042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa905fd-0901-4374-98c1-1f308dd6d0ed None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.346322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa905fd-0901-4374-98c1-1f308dd6d0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.346627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa905fd-0901-4374-98c1-1f308dd6d0ed None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.347831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa905fd-0901-4374-98c1-1f308dd6d0ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:55.349288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa905fd-0901-4374-98c1-1f308dd6d0ed None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:55.369729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:55.378576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 246/474] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:55 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 01:55:55.380499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa905fd-0901-4374-98c1-1f308dd6d0ed None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:55.443787 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a16f6-b3a3-4847-9a10-940b7c85015c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:55.485766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41734bfb-c20b-4c0e-b60e-80af26dc8812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:55.486412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41734bfb-c20b-4c0e-b60e-80af26dc8812 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.486770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41734bfb-c20b-4c0e-b60e-80af26dc8812 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.487045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41734bfb-c20b-4c0e-b60e-80af26dc8812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.502571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41734bfb-c20b-4c0e-b60e-80af26dc8812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:55.503433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41734bfb-c20b-4c0e-b60e-80af26dc8812 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-41734bfb-c20b-4c0e-b60e-80af26dc8812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:55:55.522104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:55.523240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:55.524270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:55:55.524270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:55:55.524270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:55.524270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:55.526833 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 229/475] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:55.535564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41734bfb-c20b-4c0e-b60e-80af26dc8812 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:55.593242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa905fd-0901-4374-98c1-1f308dd6d0ed None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:55.616490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:55.643675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07ba5a-2f46-4502-bf2a-00f97736b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:55.644301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07ba5a-2f46-4502-bf2a-00f97736b924 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.644605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07ba5a-2f46-4502-bf2a-00f97736b924 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.644844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07ba5a-2f46-4502-bf2a-00f97736b924 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.645558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07ba5a-2f46-4502-bf2a-00f97736b924 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:55.646984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07ba5a-2f46-4502-bf2a-00f97736b924 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:55.657779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.sql.core [None req-ae07ba5a-2f46-4502-bf2a-00f97736b924 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 01:55:55.657779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 01:55:55.657779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [parameters: {'id': 'dcd50bd5642a4cb3935b7bdbbb332909', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 01:55:55.657779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80077) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-ae07ba5a-2f46-4502-bf2a-00f97736b924 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application conn.query(q) Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application result.read() Jul 28 01:55:55.678564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 01:55:55.679515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application next(self.gen) Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application yield resource Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application next(self.gen) Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise self.value Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application session.commit() Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 01:55:55.680465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self.session.flush() Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application compat.raise_( Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 01:55:55.681866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 01:55:55.682748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application conn.query(q) Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application result.read() Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 01:55:55.685460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [parameters: {'id': 'dcd50bd5642a4cb3935b7bdbbb332909', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:55.688743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 01:55:55.691017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:55.693053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 247/476] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Jul 28 01:55:55 2022] POST /identity/v3/roles => generated 144 bytes in 300 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:55.693053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07ba5a-2f46-4502-bf2a-00f97736b924 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:55.705946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:55.710296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41734bfb-c20b-4c0e-b60e-80af26dc8812 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:55.754553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2999e27-0441-4a9d-887d-ff2e75ecfba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:55.755120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2999e27-0441-4a9d-887d-ff2e75ecfba2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.755403 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2999e27-0441-4a9d-887d-ff2e75ecfba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.755678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2999e27-0441-4a9d-887d-ff2e75ecfba2 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.756380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2999e27-0441-4a9d-887d-ff2e75ecfba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:55.756687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2999e27-0441-4a9d-887d-ff2e75ecfba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:55.758078 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2999e27-0441-4a9d-887d-ff2e75ecfba2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:55.774388 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 230/477] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:55.779916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2999e27-0441-4a9d-887d-ff2e75ecfba2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:55.824938 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07ba5a-2f46-4502-bf2a-00f97736b924 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:55.878316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae6ce8-847e-42b0-986b-7c1e7c52f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:55.879005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae6ce8-847e-42b0-986b-7c1e7c52f87e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.879286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae6ce8-847e-42b0-986b-7c1e7c52f87e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.879561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae6ce8-847e-42b0-986b-7c1e7c52f87e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.894723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae6ce8-847e-42b0-986b-7c1e7c52f87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-8dae6ce8-847e-42b0-986b-7c1e7c52f87e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:55.902519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:55.903467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 01:55:55.904238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:55.907193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 248/478] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:55:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:55.913995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2999e27-0441-4a9d-887d-ff2e75ecfba2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:55.916741 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae6ce8-847e-42b0-986b-7c1e7c52f87e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:55.975865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:55.988426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2d261-4100-46a1-b625-6988b2649e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:55.989235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2d261-4100-46a1-b625-6988b2649e65 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:55.989615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2d261-4100-46a1-b625-6988b2649e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:55.989991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2d261-4100-46a1-b625-6988b2649e65 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:55.990818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2d261-4100-46a1-b625-6988b2649e65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:55.992479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2d261-4100-46a1-b625-6988b2649e65 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:56.044933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae6ce8-847e-42b0-986b-7c1e7c52f87e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:56.049051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 231/479] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:55:55 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:55:56.082801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9077f0-aa37-4a52-a284-cbb0c3620006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:56.083935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9077f0-aa37-4a52-a284-cbb0c3620006 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:56.084417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9077f0-aa37-4a52-a284-cbb0c3620006 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:56.084906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9077f0-aa37-4a52-a284-cbb0c3620006 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:56.085862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9077f0-aa37-4a52-a284-cbb0c3620006 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:56.086364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9077f0-aa37-4a52-a284-cbb0c3620006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:56.088058 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9077f0-aa37-4a52-a284-cbb0c3620006 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:56.098017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 249/480] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:55:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:57.238595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35355ae1-c0e9-4471-a474-7e4ec7b516cf None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:57.239546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35355ae1-c0e9-4471-a474-7e4ec7b516cf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:57.240033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35355ae1-c0e9-4471-a474-7e4ec7b516cf None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:57.241799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 232/481] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:57.247966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904e71-1396-4a4b-9dcc-b9a13eab48b3 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:57.248809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904e71-1396-4a4b-9dcc-b9a13eab48b3 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:57.249304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904e71-1396-4a4b-9dcc-b9a13eab48b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:57.268551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ef904e71-1396-4a4b-9dcc-b9a13eab48b3 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:57.270049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ef904e71-1396-4a4b-9dcc-b9a13eab48b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:57.350756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 250/482] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:57.370561 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35355ae1-c0e9-4471-a474-7e4ec7b516cf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:57.392080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:57.506259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35355ae1-c0e9-4471-a474-7e4ec7b516cf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:57.517660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b3c70-5a6a-4c48-b25b-2b1194803d8b None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:57.517939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b3c70-5a6a-4c48-b25b-2b1194803d8b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:57.518216 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b3c70-5a6a-4c48-b25b-2b1194803d8b None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:57.519839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 251/483] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:57.535632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992db993-7c7e-4bf9-a7ef-64f59743c89a None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:57.535902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992db993-7c7e-4bf9-a7ef-64f59743c89a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:57.536178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992db993-7c7e-4bf9-a7ef-64f59743c89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:57.552637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f1af5-45c9-425d-9658-2b38daa8bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:57.553305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f1af5-45c9-425d-9658-2b38daa8bd94 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:57.553580 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f1af5-45c9-425d-9658-2b38daa8bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:57.553853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f1af5-45c9-425d-9658-2b38daa8bd94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:57.571957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-992db993-7c7e-4bf9-a7ef-64f59743c89a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:57.573157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-992db993-7c7e-4bf9-a7ef-64f59743c89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:57.575961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f1af5-45c9-425d-9658-2b38daa8bd94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b52f1af5-45c9-425d-9658-2b38daa8bd94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:57.581434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:57.582303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:57.583156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 233/484] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:55:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:57.591270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f1af5-45c9-425d-9658-2b38daa8bd94 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:57.622123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:57.719790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:57.725641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 252/485] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:55:57.748782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992db993-7c7e-4bf9-a7ef-64f59743c89a None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:57.772424 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f1af5-45c9-425d-9658-2b38daa8bd94 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:57.844088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ecf0-159a-4c44-8cfa-372946444054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:57.844706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ecf0-159a-4c44-8cfa-372946444054 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:57.844994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ecf0-159a-4c44-8cfa-372946444054 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:57.845267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ecf0-159a-4c44-8cfa-372946444054 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:57.846098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ecf0-159a-4c44-8cfa-372946444054 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:57.846553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ecf0-159a-4c44-8cfa-372946444054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:57.847954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ecf0-159a-4c44-8cfa-372946444054 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:57.862480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992db993-7c7e-4bf9-a7ef-64f59743c89a None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:57.876385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 234/486] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:55:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:55:57.895430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ecf0-159a-4c44-8cfa-372946444054 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:57.905933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd178b-118e-44cc-8d8c-77b28575cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:57.907411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd178b-118e-44cc-8d8c-77b28575cca0 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:57.907691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd178b-118e-44cc-8d8c-77b28575cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:57.907964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd178b-118e-44cc-8d8c-77b28575cca0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:57.925412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd178b-118e-44cc-8d8c-77b28575cca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-fccd178b-118e-44cc-8d8c-77b28575cca0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:57.930336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:57.931775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:57.932564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 253/487] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:55:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:57.940996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd178b-118e-44cc-8d8c-77b28575cca0 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:57.999431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:58.040358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ecf0-159a-4c44-8cfa-372946444054 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:58.078831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f0512-7d97-4f55-8ab2-735fbdfb09c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:58.080205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f0512-7d97-4f55-8ab2-735fbdfb09c2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.080651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f0512-7d97-4f55-8ab2-735fbdfb09c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.081067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f0512-7d97-4f55-8ab2-735fbdfb09c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.084301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:58.093073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f0512-7d97-4f55-8ab2-735fbdfb09c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:58.094896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f0512-7d97-4f55-8ab2-735fbdfb09c2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-9b9f0512-7d97-4f55-8ab2-735fbdfb09c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:55:58.111022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:58.111864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:58.112690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:55:58.112690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:55:58.112690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:58.112690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:58.115767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 235/488] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:58.121746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b49de-bc19-4d25-8703-d272b8123f74 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.122279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b49de-bc19-4d25-8703-d272b8123f74 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.122785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b49de-bc19-4d25-8703-d272b8123f74 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.124669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 236/489] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:58.125569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b49de-bc19-4d25-8703-d272b8123f74 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:58.148565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd178b-118e-44cc-8d8c-77b28575cca0 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:58.184057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed6ad4-cfb0-4fb7-ba9a-48096d757178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:58.184678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed6ad4-cfb0-4fb7-ba9a-48096d757178 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.184960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed6ad4-cfb0-4fb7-ba9a-48096d757178 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.185236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed6ad4-cfb0-4fb7-ba9a-48096d757178 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.186033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed6ad4-cfb0-4fb7-ba9a-48096d757178 None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:58.186342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed6ad4-cfb0-4fb7-ba9a-48096d757178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:58.188081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed6ad4-cfb0-4fb7-ba9a-48096d757178 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:58.197520 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 254/490] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:55:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:58.198834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dc289-7343-463d-9d78-38784017072e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.199123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dc289-7343-463d-9d78-38784017072e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.199478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dc289-7343-463d-9d78-38784017072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.217816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-910dc289-7343-463d-9d78-38784017072e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:58.219223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-910dc289-7343-463d-9d78-38784017072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:58.241150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b49de-bc19-4d25-8703-d272b8123f74 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:58.278989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4d457-9d2c-4f04-b838-6ac6156e7ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:58.279965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4d457-9d2c-4f04-b838-6ac6156e7ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.280551 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4d457-9d2c-4f04-b838-6ac6156e7ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.281029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4d457-9d2c-4f04-b838-6ac6156e7ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.281978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4d457-9d2c-4f04-b838-6ac6156e7ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:58.282531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4d457-9d2c-4f04-b838-6ac6156e7ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:58.284317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4d457-9d2c-4f04-b838-6ac6156e7ef1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:58.294902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 255/491] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:58.295736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dc289-7343-463d-9d78-38784017072e None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:58.298354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 237/492] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:58.307587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4d457-9d2c-4f04-b838-6ac6156e7ef1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:58.322576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:58.362839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:58.426055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4d457-9d2c-4f04-b838-6ac6156e7ef1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:58.441619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dc289-7343-463d-9d78-38784017072e None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:58.464980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a7c29-2d3e-4070-b700-91d1d9067081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:58.465714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a7c29-2d3e-4070-b700-91d1d9067081 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.466093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a7c29-2d3e-4070-b700-91d1d9067081 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.466514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a7c29-2d3e-4070-b700-91d1d9067081 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.474190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a7c29-2d3e-4070-b700-91d1d9067081 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:58.475572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a7c29-2d3e-4070-b700-91d1d9067081 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:58.486709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb16e5-8f3f-47c3-bf37-0fa6bfbfd351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:58.487631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb16e5-8f3f-47c3-bf37-0fa6bfbfd351 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.488086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb16e5-8f3f-47c3-bf37-0fa6bfbfd351 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.488580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb16e5-8f3f-47c3-bf37-0fa6bfbfd351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b50a7c29-2d3e-4070-b700-91d1d9067081 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:55:58.489598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:58.490523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:58.491409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 238/493] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jul 28 01:55:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:55:58.497314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a7c29-2d3e-4070-b700-91d1d9067081 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:58.513662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb16e5-8f3f-47c3-bf37-0fa6bfbfd351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:58.515895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb16e5-8f3f-47c3-bf37-0fa6bfbfd351 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-abcb16e5-8f3f-47c3-bf37-0fa6bfbfd351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:55:58.539519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:58.540649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:58.541711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:55:58.541711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:55:58.541711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:58.541711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:58.543993 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 256/494] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:58.545415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb16e5-8f3f-47c3-bf37-0fa6bfbfd351 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:58.613992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a7c29-2d3e-4070-b700-91d1d9067081 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:58.620415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:58.624104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:58.651755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde746e-ec0c-486e-a8ed-8a5d3aec1fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:58.652396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde746e-ec0c-486e-a8ed-8a5d3aec1fcd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.652675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde746e-ec0c-486e-a8ed-8a5d3aec1fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.652946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde746e-ec0c-486e-a8ed-8a5d3aec1fcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.656045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb16e5-8f3f-47c3-bf37-0fa6bfbfd351 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:58.664100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde746e-ec0c-486e-a8ed-8a5d3aec1fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-fbde746e-ec0c-486e-a8ed-8a5d3aec1fcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:58.670179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:58.671093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:58.671881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 239/495] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:55:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:58.672525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde746e-ec0c-486e-a8ed-8a5d3aec1fcd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:58.699190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3d520-3b13-4bfd-bf9a-8beb1b1f1c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:58.699809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d520-3b13-4bfd-bf9a-8beb1b1f1c6a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.700086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d520-3b13-4bfd-bf9a-8beb1b1f1c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.700360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d520-3b13-4bfd-bf9a-8beb1b1f1c6a None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.701162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3d520-3b13-4bfd-bf9a-8beb1b1f1c6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:58.701469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3d520-3b13-4bfd-bf9a-8beb1b1f1c6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:58.702955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3d520-3b13-4bfd-bf9a-8beb1b1f1c6a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:58.741634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 257/496] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jul 28 01:55:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:58.741634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a548002-14cd-434a-a751-a946ee8cd810 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.741634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a548002-14cd-434a-a751-a946ee8cd810 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.741634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a548002-14cd-434a-a751-a946ee8cd810 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.742427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 258/497] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:58.743689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a548002-14cd-434a-a751-a946ee8cd810 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:58.778579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde746e-ec0c-486e-a8ed-8a5d3aec1fcd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:58.812521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1411b-9c3f-4ce3-ba13-4181f662c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:58.813139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1411b-9c3f-4ce3-ba13-4181f662c591 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.813422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1411b-9c3f-4ce3-ba13-4181f662c591 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.813721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1411b-9c3f-4ce3-ba13-4181f662c591 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.814411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1411b-9c3f-4ce3-ba13-4181f662c591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:58.814744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1411b-9c3f-4ce3-ba13-4181f662c591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:58.816388 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1411b-9c3f-4ce3-ba13-4181f662c591 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:58.828311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 240/498] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:58.829464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13b4d-7164-4edc-9a70-d3b08b1952e2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.829745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13b4d-7164-4edc-9a70-d3b08b1952e2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.830015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13b4d-7164-4edc-9a70-d3b08b1952e2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.831390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 241/499] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:55:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:55:58.831926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c13b4d-7164-4edc-9a70-d3b08b1952e2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:58.846792 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a548002-14cd-434a-a751-a946ee8cd810 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:58.860167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:58.874576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:58.884481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eb94f-f493-4f43-bf02-7fe1943cbff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:58.885104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eb94f-f493-4f43-bf02-7fe1943cbff7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.885390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eb94f-f493-4f43-bf02-7fe1943cbff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.885666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eb94f-f493-4f43-bf02-7fe1943cbff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.886399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680eb94f-f493-4f43-bf02-7fe1943cbff7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:58.886745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680eb94f-f493-4f43-bf02-7fe1943cbff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:58.888146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680eb94f-f493-4f43-bf02-7fe1943cbff7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:58.896406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 259/500] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:55:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:58.897634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4bf92-5581-4de7-b4f5-6c6438fced76 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.897927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4bf92-5581-4de7-b4f5-6c6438fced76 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.898207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4bf92-5581-4de7-b4f5-6c6438fced76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.915895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-77e4bf92-5581-4de7-b4f5-6c6438fced76 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:58.917091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-77e4bf92-5581-4de7-b4f5-6c6438fced76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:58.936791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c13b4d-7164-4edc-9a70-d3b08b1952e2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:58.969974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb8363-d14c-4814-9db1-a1053efb0961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:58.970594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb8363-d14c-4814-9db1-a1053efb0961 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:58.970882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb8363-d14c-4814-9db1-a1053efb0961 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:58.971150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb8363-d14c-4814-9db1-a1053efb0961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:58.981881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 260/501] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:58.982696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4bf92-5581-4de7-b4f5-6c6438fced76 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.042832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb8363-d14c-4814-9db1-a1053efb0961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:59.044304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb8363-d14c-4814-9db1-a1053efb0961 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:59.070372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:59.079692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4bf92-5581-4de7-b4f5-6c6438fced76 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:59.097382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:59.114705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f07080-96a7-4065-83e4-5175e0042dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:59.115347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07080-96a7-4065-83e4-5175e0042dcf None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.115628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07080-96a7-4065-83e4-5175e0042dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.115902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07080-96a7-4065-83e4-5175e0042dcf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.123581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f07080-96a7-4065-83e4-5175e0042dcf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:59.125052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f07080-96a7-4065-83e4-5175e0042dcf None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-80f07080-96a7-4065-83e4-5175e0042dcf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:55:59.138196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:59.139180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:59.140038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 261/502] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:55:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:59.140570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310f4a8-b5cc-419f-b865-9feff3a9f004 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.140866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310f4a8-b5cc-419f-b865-9feff3a9f004 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.141015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310f4a8-b5cc-419f-b865-9feff3a9f004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.146784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 242/503] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:55:59.148635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb8363-d14c-4814-9db1-a1053efb0961 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.158352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e310f4a8-b5cc-419f-b865-9feff3a9f004 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:55:59.159574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e310f4a8-b5cc-419f-b865-9feff3a9f004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:55:59.224832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 262/504] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:55:59.225654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310f4a8-b5cc-419f-b865-9feff3a9f004 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.258596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb8363-d14c-4814-9db1-a1053efb0961 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:59.285003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:59.293316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998764a-ab54-46e7-a67a-5002835be8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:59.293947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998764a-ab54-46e7-a67a-5002835be8ee None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.294222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998764a-ab54-46e7-a67a-5002835be8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.294521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998764a-ab54-46e7-a67a-5002835be8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.304467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998764a-ab54-46e7-a67a-5002835be8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:59.306470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998764a-ab54-46e7-a67a-5002835be8ee None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8998764a-ab54-46e7-a67a-5002835be8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:55:59.320838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:59.322223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:59.323095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:55:59.323095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:55:59.323095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:59.323095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:59.323095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 243/505] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:59.323347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998764a-ab54-46e7-a67a-5002835be8ee None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.330998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310f4a8-b5cc-419f-b865-9feff3a9f004 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:59.340794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:59.365337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071e2f0-689c-4c37-8e4b-8c1f7136fe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:59.365970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071e2f0-689c-4c37-8e4b-8c1f7136fe0a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.366247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071e2f0-689c-4c37-8e4b-8c1f7136fe0a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.366544 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071e2f0-689c-4c37-8e4b-8c1f7136fe0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.376810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071e2f0-689c-4c37-8e4b-8c1f7136fe0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:59.378274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071e2f0-689c-4c37-8e4b-8c1f7136fe0a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-b071e2f0-689c-4c37-8e4b-8c1f7136fe0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:55:59.393371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:59.394222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:59.395316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:55:59.395316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:55:59.395316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:59.395316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:59.395316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 263/506] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:59.395316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071e2f0-689c-4c37-8e4b-8c1f7136fe0a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.425606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998764a-ab54-46e7-a67a-5002835be8ee None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:59.458283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243fbd5-8fba-4801-a0cd-6bb0fdc202bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:59.458914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243fbd5-8fba-4801-a0cd-6bb0fdc202bd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.459186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243fbd5-8fba-4801-a0cd-6bb0fdc202bd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.459453 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243fbd5-8fba-4801-a0cd-6bb0fdc202bd None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.460239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243fbd5-8fba-4801-a0cd-6bb0fdc202bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:59.460538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243fbd5-8fba-4801-a0cd-6bb0fdc202bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:59.462509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243fbd5-8fba-4801-a0cd-6bb0fdc202bd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:59.494987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071e2f0-689c-4c37-8e4b-8c1f7136fe0a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:59.498294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 244/507] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jul 28 01:55:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:59.499126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243fbd5-8fba-4801-a0cd-6bb0fdc202bd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.529492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb78b1-ebe2-41f2-8819-86aae2a71a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:59.530120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb78b1-ebe2-41f2-8819-86aae2a71a97 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.530403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb78b1-ebe2-41f2-8819-86aae2a71a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.530718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb78b1-ebe2-41f2-8819-86aae2a71a97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.538238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:59.542515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb78b1-ebe2-41f2-8819-86aae2a71a97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:59.543995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb78b1-ebe2-41f2-8819-86aae2a71a97 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-fcfb78b1-ebe2-41f2-8819-86aae2a71a97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:55:59.558352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:59.559219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:59.560046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:55:59.560046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:55:59.560046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:55:59.560046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:55:59.560046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 264/508] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:59.560683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb78b1-ebe2-41f2-8819-86aae2a71a97 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.575695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:59.610888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243fbd5-8fba-4801-a0cd-6bb0fdc202bd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:59.644160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67b7a2-9426-43c8-b180-4afde6f16dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:59.644796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b7a2-9426-43c8-b180-4afde6f16dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.645077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b7a2-9426-43c8-b180-4afde6f16dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.645343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b7a2-9426-43c8-b180-4afde6f16dc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.655353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67b7a2-9426-43c8-b180-4afde6f16dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:55:59.659380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb78b1-ebe2-41f2-8819-86aae2a71a97 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7c67b7a2-9426-43c8-b180-4afde6f16dc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:55:59.660245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:55:59.661191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 245/509] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:55:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:55:59.667577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67b7a2-9426-43c8-b180-4afde6f16dc9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.693090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b1677-9692-473f-9ed2-3c200e0ae97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:59.693710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b1677-9692-473f-9ed2-3c200e0ae97a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.693991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b1677-9692-473f-9ed2-3c200e0ae97a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.694264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b1677-9692-473f-9ed2-3c200e0ae97a None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.694996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b1677-9692-473f-9ed2-3c200e0ae97a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:59.695299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b1677-9692-473f-9ed2-3c200e0ae97a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:59.697208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b1677-9692-473f-9ed2-3c200e0ae97a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:59.716101 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 265/510] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:59.716939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b1677-9692-473f-9ed2-3c200e0ae97a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.767761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:59.771971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67b7a2-9426-43c8-b180-4afde6f16dc9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:59.785261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:55:59.806420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa26a7-5111-498c-9616-dd920986378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:59.807069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa26a7-5111-498c-9616-dd920986378a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.807347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa26a7-5111-498c-9616-dd920986378a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.807620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa26a7-5111-498c-9616-dd920986378a None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.808311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa26a7-5111-498c-9616-dd920986378a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:59.808611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa26a7-5111-498c-9616-dd920986378a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:59.809995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa26a7-5111-498c-9616-dd920986378a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:59.814223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b1677-9692-473f-9ed2-3c200e0ae97a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:59.821739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 246/511] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:59.822552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa26a7-5111-498c-9616-dd920986378a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.854108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d56e4-3ceb-4b71-b1f8-3a2b0dc9b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:59.854681 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d56e4-3ceb-4b71-b1f8-3a2b0dc9b703 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.854964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d56e4-3ceb-4b71-b1f8-3a2b0dc9b703 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.855240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d56e4-3ceb-4b71-b1f8-3a2b0dc9b703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.921976 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa26a7-5111-498c-9616-dd920986378a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:55:59.926921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d56e4-3ceb-4b71-b1f8-3a2b0dc9b703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:59.928491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d56e4-3ceb-4b71-b1f8-3a2b0dc9b703 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:59.956638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75686173-9119-4593-a040-844ef52af87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:55:59.957248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75686173-9119-4593-a040-844ef52af87a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:55:59.957527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75686173-9119-4593-a040-844ef52af87a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:55:59.957801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75686173-9119-4593-a040-844ef52af87a None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:55:59.958515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75686173-9119-4593-a040-844ef52af87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:55:59.958820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75686173-9119-4593-a040-844ef52af87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:55:59.960168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75686173-9119-4593-a040-844ef52af87a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:55:59.972233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 247/512] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:55:59.973011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75686173-9119-4593-a040-844ef52af87a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:55:59.991137 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:00.001471 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:00.032314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 266/513] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:00.033332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d56e4-3ceb-4b71-b1f8-3a2b0dc9b703 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.073150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75686173-9119-4593-a040-844ef52af87a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.107400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cde25-3d19-4ced-b484-55b5abf809ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.107952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cde25-3d19-4ced-b484-55b5abf809ab None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.108238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cde25-3d19-4ced-b484-55b5abf809ab None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.108513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cde25-3d19-4ced-b484-55b5abf809ab None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.109226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cde25-3d19-4ced-b484-55b5abf809ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:00.109531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cde25-3d19-4ced-b484-55b5abf809ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:00.110949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cde25-3d19-4ced-b484-55b5abf809ab None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:00.118803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 248/514] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:55:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:00.119560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cde25-3d19-4ced-b484-55b5abf809ab None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.135754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d56e4-3ceb-4b71-b1f8-3a2b0dc9b703 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.170003 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064006a7-405c-4436-9418-5729930a3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.170666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064006a7-405c-4436-9418-5729930a3f56 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.170944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064006a7-405c-4436-9418-5729930a3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.171222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064006a7-405c-4436-9418-5729930a3f56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.178169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064006a7-405c-4436-9418-5729930a3f56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:00.179653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064006a7-405c-4436-9418-5729930a3f56 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-064006a7-405c-4436-9418-5729930a3f56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:00.191238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:00.192131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:00.193009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 267/515] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:00.193552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064006a7-405c-4436-9418-5729930a3f56 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.199973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:00.220265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cde25-3d19-4ced-b484-55b5abf809ab None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.226288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:00.253588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeddf5b-4fbf-4cd4-a680-c2bab25bbe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.254207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeddf5b-4fbf-4cd4-a680-c2bab25bbe79 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.254522 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeddf5b-4fbf-4cd4-a680-c2bab25bbe79 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.254805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeddf5b-4fbf-4cd4-a680-c2bab25bbe79 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.255477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeddf5b-4fbf-4cd4-a680-c2bab25bbe79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:00.256911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeddf5b-4fbf-4cd4-a680-c2bab25bbe79 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:00.278221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 249/516] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:56:00 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:00.279057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeddf5b-4fbf-4cd4-a680-c2bab25bbe79 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.299642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064006a7-405c-4436-9418-5729930a3f56 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.340940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6b9e4-fdea-4221-88e4-4e7b9f565048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.341588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6b9e4-fdea-4221-88e4-4e7b9f565048 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.341873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6b9e4-fdea-4221-88e4-4e7b9f565048 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.342130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6b9e4-fdea-4221-88e4-4e7b9f565048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.350331 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6b9e4-fdea-4221-88e4-4e7b9f565048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:00.352128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6b9e4-fdea-4221-88e4-4e7b9f565048 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-c6f6b9e4-fdea-4221-88e4-4e7b9f565048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:00.366825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:00.367743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:00.369398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:00.369398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:00.369398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:00.369398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:00.369398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:00.369398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:00.369398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:00.369398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:00.373505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 268/517] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:00.374492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6b9e4-fdea-4221-88e4-4e7b9f565048 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.395945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeddf5b-4fbf-4cd4-a680-c2bab25bbe79 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.435872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed332fd-a8e0-4ed0-b886-5f158e966106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.436514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed332fd-a8e0-4ed0-b886-5f158e966106 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.437300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed332fd-a8e0-4ed0-b886-5f158e966106 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.437300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed332fd-a8e0-4ed0-b886-5f158e966106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.444656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:00.448735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed332fd-a8e0-4ed0-b886-5f158e966106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:00.450311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed332fd-a8e0-4ed0-b886-5f158e966106 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-fed332fd-a8e0-4ed0-b886-5f158e966106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:00.466997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:00.467874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:00.468696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:00.468696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:00.468696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:00.468696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:00.468696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 250/518] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:00.470105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed332fd-a8e0-4ed0-b886-5f158e966106 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.490506 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:00.501210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6b9e4-fdea-4221-88e4-4e7b9f565048 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.537220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9bbf3-3ec2-43ea-ac40-3671cb673442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.537869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9bbf3-3ec2-43ea-ac40-3671cb673442 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.538134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9bbf3-3ec2-43ea-ac40-3671cb673442 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.538409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9bbf3-3ec2-43ea-ac40-3671cb673442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.550158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9bbf3-3ec2-43ea-ac40-3671cb673442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:00.551667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9bbf3-3ec2-43ea-ac40-3671cb673442 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-9ef9bbf3-3ec2-43ea-ac40-3671cb673442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:00.567179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:00.568057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:00.569330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:00.569330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:00.569330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:00.569330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:00.569330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 269/519] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:00.569330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9bbf3-3ec2-43ea-ac40-3671cb673442 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.583148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed332fd-a8e0-4ed0-b886-5f158e966106 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.624181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5acb-ec4b-4722-ae55-a20a4af4d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.625145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5acb-ec4b-4722-ae55-a20a4af4d87a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.625629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5acb-ec4b-4722-ae55-a20a4af4d87a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.626103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5acb-ec4b-4722-ae55-a20a4af4d87a None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.627140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea5acb-ec4b-4722-ae55-a20a4af4d87a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:00.627671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea5acb-ec4b-4722-ae55-a20a4af4d87a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:00.629316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea5acb-ec4b-4722-ae55-a20a4af4d87a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:00.656255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 251/520] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jul 28 01:56:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:00.657141 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5acb-ec4b-4722-ae55-a20a4af4d87a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.686457 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9bbf3-3ec2-43ea-ac40-3671cb673442 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.709667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:00.724887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3469a-d8e0-4498-ac9e-96340e19c95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.725508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3469a-d8e0-4498-ac9e-96340e19c95a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.725790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3469a-d8e0-4498-ac9e-96340e19c95a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.726065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3469a-d8e0-4498-ac9e-96340e19c95a None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.726855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3469a-d8e0-4498-ac9e-96340e19c95a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:00.727164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3469a-d8e0-4498-ac9e-96340e19c95a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:00.728659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3469a-d8e0-4498-ac9e-96340e19c95a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:00.747163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 270/521] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:00.747995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3469a-d8e0-4498-ac9e-96340e19c95a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.756214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:00.778840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5acb-ec4b-4722-ae55-a20a4af4d87a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.816387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f5c5e-704f-454f-b181-ed910bd8d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.817009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f5c5e-704f-454f-b181-ed910bd8d755 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.817284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f5c5e-704f-454f-b181-ed910bd8d755 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.817559 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f5c5e-704f-454f-b181-ed910bd8d755 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.818254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f5c5e-704f-454f-b181-ed910bd8d755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:00.818662 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f5c5e-704f-454f-b181-ed910bd8d755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:00.820037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f5c5e-704f-454f-b181-ed910bd8d755 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:00.835932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 252/522] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:00.835932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f5c5e-704f-454f-b181-ed910bd8d755 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.866530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3469a-d8e0-4498-ac9e-96340e19c95a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.904372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7e9eb-20a1-475a-9f55-d28153a2e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.905244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e9eb-20a1-475a-9f55-d28153a2e375 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.905526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e9eb-20a1-475a-9f55-d28153a2e375 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.905800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e9eb-20a1-475a-9f55-d28153a2e375 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.906527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7e9eb-20a1-475a-9f55-d28153a2e375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:00.906839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7e9eb-20a1-475a-9f55-d28153a2e375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:00.908219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7e9eb-20a1-475a-9f55-d28153a2e375 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:00.924676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 271/523] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:00.924676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7e9eb-20a1-475a-9f55-d28153a2e375 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:00.944877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f5c5e-704f-454f-b181-ed910bd8d755 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:00.952644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:00.988004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd6b7f-0b64-4570-af6f-667f9b3f559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:00.988627 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd6b7f-0b64-4570-af6f-667f9b3f559e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:00.988911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd6b7f-0b64-4570-af6f-667f9b3f559e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:00.989181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd6b7f-0b64-4570-af6f-667f9b3f559e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:00.992666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:01.032573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7e9eb-20a1-475a-9f55-d28153a2e375 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:01.064835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd6b7f-0b64-4570-af6f-667f9b3f559e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:01.066761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd6b7f-0b64-4570-af6f-667f9b3f559e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:01.069345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101db22-57f9-4939-9803-ef86c15d89b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:01.070051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101db22-57f9-4939-9803-ef86c15d89b3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:01.070338 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101db22-57f9-4939-9803-ef86c15d89b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:01.070657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101db22-57f9-4939-9803-ef86c15d89b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:01.071982 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101db22-57f9-4939-9803-ef86c15d89b3 None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=b9f911e716994f1f9d4705216ee0f3a5) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:01.072294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101db22-57f9-4939-9803-ef86c15d89b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:01.073735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101db22-57f9-4939-9803-ef86c15d89b3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:01.086481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 272/524] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:00 2022] GET /identity/v3/role_assignments?user.id=b9f911e716994f1f9d4705216ee0f3a5&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:01.086481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101db22-57f9-4939-9803-ef86c15d89b3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:01.204901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101db22-57f9-4939-9803-ef86c15d89b3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:01.222928 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 253/525] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:01.223908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd6b7f-0b64-4570-af6f-667f9b3f559e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:01.234224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:01.243618 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:01.253422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303e809-12e8-48bf-a361-929735d04830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:01.254152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303e809-12e8-48bf-a361-929735d04830 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:01.254541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303e809-12e8-48bf-a361-929735d04830 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:01.254891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303e809-12e8-48bf-a361-929735d04830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:01.264025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303e809-12e8-48bf-a361-929735d04830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:01.266059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303e809-12e8-48bf-a361-929735d04830 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-a303e809-12e8-48bf-a361-929735d04830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:01.281511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:01.282378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:01.283240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:01.283240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:01.283240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:01.283240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:01.283240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:01.283240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:01.283240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:01.283240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:01.286522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 273/526] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:01.287360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303e809-12e8-48bf-a361-929735d04830 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:01.347265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd6b7f-0b64-4570-af6f-667f9b3f559e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:01.395367 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37ddb3-2cda-4c49-82bb-82a408b7bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:01.396578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37ddb3-2cda-4c49-82bb-82a408b7bb5b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:01.397045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37ddb3-2cda-4c49-82bb-82a408b7bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:01.397307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37ddb3-2cda-4c49-82bb-82a408b7bb5b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:01.407859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37ddb3-2cda-4c49-82bb-82a408b7bb5b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:01.409777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37ddb3-2cda-4c49-82bb-82a408b7bb5b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:01.418480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303e809-12e8-48bf-a361-929735d04830 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3a37ddb3-2cda-4c49-82bb-82a408b7bb5b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:01.424657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:01.425555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:01.426470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:01.426470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:01.426470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:01.426470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:01.426470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:01.426470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:01.426470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:01.426470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:01.426470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 01:56:01.426470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:01.426996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 254/527] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:01.427394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37ddb3-2cda-4c49-82bb-82a408b7bb5b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:01.467493 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181f88f-9fe0-475d-80c8-b6305a020894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:01.468302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181f88f-9fe0-475d-80c8-b6305a020894 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:01.468586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181f88f-9fe0-475d-80c8-b6305a020894 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:01.469745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181f88f-9fe0-475d-80c8-b6305a020894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:01.483152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181f88f-9fe0-475d-80c8-b6305a020894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:01.485383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181f88f-9fe0-475d-80c8-b6305a020894 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:01.502391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-3181f88f-9fe0-475d-80c8-b6305a020894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:01.505385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:01.506219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:01.507169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:01.507169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:01.507169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:01.507169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:01.507395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 274/528] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:01.508023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181f88f-9fe0-475d-80c8-b6305a020894 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:01.547375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37ddb3-2cda-4c49-82bb-82a408b7bb5b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:01.565087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:01.588549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202c28-099c-42fa-b20d-6b23763bda92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:01.589170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202c28-099c-42fa-b20d-6b23763bda92 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:01.589545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202c28-099c-42fa-b20d-6b23763bda92 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:01.589827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202c28-099c-42fa-b20d-6b23763bda92 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:01.590887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6202c28-099c-42fa-b20d-6b23763bda92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:01.591204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6202c28-099c-42fa-b20d-6b23763bda92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:01.593283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6202c28-099c-42fa-b20d-6b23763bda92 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:01.619067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 255/529] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:01.619999 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202c28-099c-42fa-b20d-6b23763bda92 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:01.636346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181f88f-9fe0-475d-80c8-b6305a020894 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:01.680279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d109e-afb4-459f-ae83-0f64d3d1c39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:01.681778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d109e-afb4-459f-ae83-0f64d3d1c39f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:01.682160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d109e-afb4-459f-ae83-0f64d3d1c39f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:01.682524 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d109e-afb4-459f-ae83-0f64d3d1c39f None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:01.684209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d109e-afb4-459f-ae83-0f64d3d1c39f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:01.684917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d109e-afb4-459f-ae83-0f64d3d1c39f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:01.687236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d109e-afb4-459f-ae83-0f64d3d1c39f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:01.711433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 275/530] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Jul 28 01:56:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:01.712396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d109e-afb4-459f-ae83-0f64d3d1c39f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:01.742892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202c28-099c-42fa-b20d-6b23763bda92 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:01.771575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:01.782471 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d956a2-9cbf-49bb-ba13-00adc08456bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:01.783207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d956a2-9cbf-49bb-ba13-00adc08456bd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:01.783557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d956a2-9cbf-49bb-ba13-00adc08456bd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:01.783924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d956a2-9cbf-49bb-ba13-00adc08456bd None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:01.784694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d956a2-9cbf-49bb-ba13-00adc08456bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:01.785067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d956a2-9cbf-49bb-ba13-00adc08456bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:01.786633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d956a2-9cbf-49bb-ba13-00adc08456bd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:01.798775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 256/531] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:01.804245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d956a2-9cbf-49bb-ba13-00adc08456bd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:01.841389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:01.847736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d109e-afb4-459f-ae83-0f64d3d1c39f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:01.900411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9260bf-de94-4a40-8cb4-b03c3094a816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:01.901509 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9260bf-de94-4a40-8cb4-b03c3094a816 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:01.901932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9260bf-de94-4a40-8cb4-b03c3094a816 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:01.902808 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9260bf-de94-4a40-8cb4-b03c3094a816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:01.903802 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9260bf-de94-4a40-8cb4-b03c3094a816 None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=ece4e0b16a9441b5ba14bbc8ff1c632c) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:01.904250 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9260bf-de94-4a40-8cb4-b03c3094a816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:01.906458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9260bf-de94-4a40-8cb4-b03c3094a816 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:01.915476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 276/532] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:01 2022] GET /identity/v3/role_assignments?user.id=ece4e0b16a9441b5ba14bbc8ff1c632c&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:01.916463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9260bf-de94-4a40-8cb4-b03c3094a816 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:01.927574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d956a2-9cbf-49bb-ba13-00adc08456bd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:02.007164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaf6de-2cf0-4ebd-8260-368db98048f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:02.009787 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf6de-2cf0-4ebd-8260-368db98048f1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:02.010966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf6de-2cf0-4ebd-8260-368db98048f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:02.011577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf6de-2cf0-4ebd-8260-368db98048f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:02.089275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9260bf-de94-4a40-8cb4-b03c3094a816 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:02.135055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:02.160794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e61d52-7fe8-4b63-9828-cedb62704e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:02.162258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e61d52-7fe8-4b63-9828-cedb62704e9c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:02.162928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e61d52-7fe8-4b63-9828-cedb62704e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:02.163413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e61d52-7fe8-4b63-9828-cedb62704e9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:02.167474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaf6de-2cf0-4ebd-8260-368db98048f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:02.168974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaf6de-2cf0-4ebd-8260-368db98048f1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:02.171880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e61d52-7fe8-4b63-9828-cedb62704e9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:02.173531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e61d52-7fe8-4b63-9828-cedb62704e9c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-a9e61d52-7fe8-4b63-9828-cedb62704e9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:02.186936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:02.187869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:02.188706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:02.188706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:02.188706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:02.188706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:02.188706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:02.188706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:02.188706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:02.188706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:02.192156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 277/533] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:02.200611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e61d52-7fe8-4b63-9828-cedb62704e9c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:02.230276 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:02.341002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 257/534] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:02.346736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaf6de-2cf0-4ebd-8260-368db98048f1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:02.356718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e61d52-7fe8-4b63-9828-cedb62704e9c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:02.391323 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619f9d-4318-4c63-8235-5664a2943ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:02.391943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f9d-4318-4c63-8235-5664a2943ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:02.392227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f9d-4318-4c63-8235-5664a2943ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:02.392485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f9d-4318-4c63-8235-5664a2943ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:02.393242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619f9d-4318-4c63-8235-5664a2943ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:02.393548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619f9d-4318-4c63-8235-5664a2943ea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:02.395034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619f9d-4318-4c63-8235-5664a2943ea0 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:02.408263 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 278/535] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:02.409518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557348d-c561-4e93-9326-9d24d7c5454c None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:02.409804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557348d-c561-4e93-9326-9d24d7c5454c None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:02.410077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557348d-c561-4e93-9326-9d24d7c5454c None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:02.411318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 279/536] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:02.416142 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557348d-c561-4e93-9326-9d24d7c5454c None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:02.456263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:02.474032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaf6de-2cf0-4ebd-8260-368db98048f1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:02.510421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49754383-e041-43ec-ab99-ab775d3b7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:02.510771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49754383-e041-43ec-ab99-ab775d3b7b4f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:02.511164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49754383-e041-43ec-ab99-ab775d3b7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:02.511533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49754383-e041-43ec-ab99-ab775d3b7b4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:02.522385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49754383-e041-43ec-ab99-ab775d3b7b4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:02.523994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49754383-e041-43ec-ab99-ab775d3b7b4f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:02.525179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-49754383-e041-43ec-ab99-ab775d3b7b4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:02.540363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:02.541417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:02.542467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:02.542467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:02.542467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:02.542467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:02.548212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 258/537] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:02.548212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35963-d079-43bd-8b56-9faf395b6350 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:02.548212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35963-d079-43bd-8b56-9faf395b6350 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:02.548212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35963-d079-43bd-8b56-9faf395b6350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:02.556858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557348d-c561-4e93-9326-9d24d7c5454c None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:02.564439 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c2b35963-d079-43bd-8b56-9faf395b6350 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:02.566045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c2b35963-d079-43bd-8b56-9faf395b6350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:02.599169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a0fad-98c4-4d4c-8e30-974a7d8b6493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:02.600132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a0fad-98c4-4d4c-8e30-974a7d8b6493 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:02.600543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a0fad-98c4-4d4c-8e30-974a7d8b6493 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:02.601029 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a0fad-98c4-4d4c-8e30-974a7d8b6493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:02.601952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a0fad-98c4-4d4c-8e30-974a7d8b6493 None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=983bd6880830419f9158b33411b57f04) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:02.602952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a0fad-98c4-4d4c-8e30-974a7d8b6493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:02.605450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a0fad-98c4-4d4c-8e30-974a7d8b6493 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:02.612438 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 280/538] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:02 2022] GET /identity/v3/role_assignments?user.id=983bd6880830419f9158b33411b57f04&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:02.613485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a0fad-98c4-4d4c-8e30-974a7d8b6493 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:02.641363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 259/539] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:02.666540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35963-d079-43bd-8b56-9faf395b6350 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:02.744713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:02.746799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a0fad-98c4-4d4c-8e30-974a7d8b6493 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:02.782958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35963-d079-43bd-8b56-9faf395b6350 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:02.793385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd6127-4586-476a-afb0-8a6cf3e2c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:02.794671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6127-4586-476a-afb0-8a6cf3e2c349 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:02.795095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6127-4586-476a-afb0-8a6cf3e2c349 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:02.795507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6127-4586-476a-afb0-8a6cf3e2c349 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:02.797055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6127-4586-476a-afb0-8a6cf3e2c349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:02.797515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6127-4586-476a-afb0-8a6cf3e2c349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:02.799328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6127-4586-476a-afb0-8a6cf3e2c349 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:02.815286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 281/540] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:02.821395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd6127-4586-476a-afb0-8a6cf3e2c349 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:02.841548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:02.853102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca293e-e5f6-45ea-aa25-307f24b42805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:02.854031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca293e-e5f6-45ea-aa25-307f24b42805 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:02.854508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca293e-e5f6-45ea-aa25-307f24b42805 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:02.854950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca293e-e5f6-45ea-aa25-307f24b42805 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:02.877501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca293e-e5f6-45ea-aa25-307f24b42805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d0ca293e-e5f6-45ea-aa25-307f24b42805 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:02.885292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:02.886184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:02.886991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 260/541] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:02.895433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca293e-e5f6-45ea-aa25-307f24b42805 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:03.020256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd6127-4586-476a-afb0-8a6cf3e2c349 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:03.072971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca293e-e5f6-45ea-aa25-307f24b42805 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:03.086000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8906c-ee35-40f6-a2db-d2849e56daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:03.086696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8906c-ee35-40f6-a2db-d2849e56daa0 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:03.086977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8906c-ee35-40f6-a2db-d2849e56daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:03.087247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8906c-ee35-40f6-a2db-d2849e56daa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:03.098141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8906c-ee35-40f6-a2db-d2849e56daa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:03.099806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8906c-ee35-40f6-a2db-d2849e56daa0 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-a4a8906c-ee35-40f6-a2db-d2849e56daa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:03.120501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:03.121378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:03.122203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:03.122203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:03.122203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:03.122203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:03.122203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:03.122203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:03.122203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:03.122203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:03.124721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 282/542] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:03.130455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8906c-ee35-40f6-a2db-d2849e56daa0 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:03.132161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:03.136087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a43e9d-8442-46db-88c5-f088526e941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:03.136713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a43e9d-8442-46db-88c5-f088526e941a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:03.137049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a43e9d-8442-46db-88c5-f088526e941a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:03.137318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a43e9d-8442-46db-88c5-f088526e941a None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:03.138053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a43e9d-8442-46db-88c5-f088526e941a None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:03.138527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a43e9d-8442-46db-88c5-f088526e941a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:03.142054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a43e9d-8442-46db-88c5-f088526e941a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:03.159789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 261/543] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:03.165866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a43e9d-8442-46db-88c5-f088526e941a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:03.262800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:03.327728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a43e9d-8442-46db-88c5-f088526e941a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:03.334581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8906c-ee35-40f6-a2db-d2849e56daa0 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:03.370118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70783-a885-4c35-bda7-5b6f5c3d35d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:03.370848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70783-a885-4c35-bda7-5b6f5c3d35d6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:03.371170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70783-a885-4c35-bda7-5b6f5c3d35d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:03.371446 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70783-a885-4c35-bda7-5b6f5c3d35d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:03.379744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084384ae-9895-4d99-b709-aed8b7fbfe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:03.380491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084384ae-9895-4d99-b709-aed8b7fbfe93 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:03.380776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084384ae-9895-4d99-b709-aed8b7fbfe93 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:03.381052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084384ae-9895-4d99-b709-aed8b7fbfe93 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:03.381812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084384ae-9895-4d99-b709-aed8b7fbfe93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:03.382119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084384ae-9895-4d99-b709-aed8b7fbfe93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:03.383226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70783-a885-4c35-bda7-5b6f5c3d35d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:03.384130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084384ae-9895-4d99-b709-aed8b7fbfe93 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:03.385701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70783-a885-4c35-bda7-5b6f5c3d35d6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:03.397363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 283/544] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:03.398714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685f680-8677-41dc-b7d5-f5921195246c None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:03.399002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685f680-8677-41dc-b7d5-f5921195246c None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:03.399340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685f680-8677-41dc-b7d5-f5921195246c None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-cfc70783-a885-4c35-bda7-5b6f5c3d35d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:03.401612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:03.402400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:03.403525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:03.403525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:03.403525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:03.403525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:03.404636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 284/545] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:03.405416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685f680-8677-41dc-b7d5-f5921195246c None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:03.405541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 262/546] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:03.411127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce4c3-862e-4a9b-8679-91d7310f5c78 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:03.411581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce4c3-862e-4a9b-8679-91d7310f5c78 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:03.412023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce4c3-862e-4a9b-8679-91d7310f5c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:03.433549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e21ce4c3-862e-4a9b-8679-91d7310f5c78 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:03.435906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e21ce4c3-862e-4a9b-8679-91d7310f5c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:03.475334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:03.509642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 263/547] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:03.510662 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ce4c3-862e-4a9b-8679-91d7310f5c78 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:03.534099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685f680-8677-41dc-b7d5-f5921195246c None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:03.569274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:03.583025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94af2d-9dff-48db-b455-499814e4f8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:03.583648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94af2d-9dff-48db-b455-499814e4f8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:03.583929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94af2d-9dff-48db-b455-499814e4f8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:03.584201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94af2d-9dff-48db-b455-499814e4f8e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:03.584992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94af2d-9dff-48db-b455-499814e4f8e7 None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=50bf5763fbf94aa9b438a1be6ce88c58) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:03.585553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94af2d-9dff-48db-b455-499814e4f8e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:03.588130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94af2d-9dff-48db-b455-499814e4f8e7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:03.595867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 285/548] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:03 2022] GET /identity/v3/role_assignments?user.id=50bf5763fbf94aa9b438a1be6ce88c58&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:03.596609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94af2d-9dff-48db-b455-499814e4f8e7 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:03.658617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ce4c3-862e-4a9b-8679-91d7310f5c78 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:03.741914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d80555-6507-4c9d-956f-eda0613e2367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:03.742744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d80555-6507-4c9d-956f-eda0613e2367 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:03.743063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d80555-6507-4c9d-956f-eda0613e2367 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:03.743386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d80555-6507-4c9d-956f-eda0613e2367 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:03.744109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d80555-6507-4c9d-956f-eda0613e2367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:03.744412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d80555-6507-4c9d-956f-eda0613e2367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:03.745911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d80555-6507-4c9d-956f-eda0613e2367 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:03.765105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 264/549] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:03.770757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d80555-6507-4c9d-956f-eda0613e2367 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:03.779235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94af2d-9dff-48db-b455-499814e4f8e7 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:03.815475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3c23-fdcd-4bf6-8680-b7f47b716eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:03.816382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3c23-fdcd-4bf6-8680-b7f47b716eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:03.816666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3c23-fdcd-4bf6-8680-b7f47b716eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:03.816937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3c23-fdcd-4bf6-8680-b7f47b716eb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:03.827122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:03.827765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc3c23-fdcd-4bf6-8680-b7f47b716eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-72fc3c23-fdcd-4bf6-8680-b7f47b716eb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:03.837198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:03.838717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:03.839685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:03.843565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 286/550] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:03.844765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3c23-fdcd-4bf6-8680-b7f47b716eb1 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:03.912020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:03.915248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d80555-6507-4c9d-956f-eda0613e2367 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:03.954207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987923bf-15c5-4666-b9ac-887d54a56a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:03.955234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987923bf-15c5-4666-b9ac-887d54a56a82 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:03.955662 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987923bf-15c5-4666-b9ac-887d54a56a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:03.956078 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987923bf-15c5-4666-b9ac-887d54a56a82 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:03.965635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987923bf-15c5-4666-b9ac-887d54a56a82 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:03.967412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987923bf-15c5-4666-b9ac-887d54a56a82 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:03.967712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3c23-fdcd-4bf6-8680-b7f47b716eb1 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-987923bf-15c5-4666-b9ac-887d54a56a82 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:03.980938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:03.981962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:03.982930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:03.982930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:03.982930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:03.982930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:03.982930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:03.982930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:03.982930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:03.982930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:03.982930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:03.982930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:03.985637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 265/551] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:03.995483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987923bf-15c5-4666-b9ac-887d54a56a82 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:04.003717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dcc5d-5b47-4346-bc75-b3e6c4075c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:04.004345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dcc5d-5b47-4346-bc75-b3e6c4075c34 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.004628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dcc5d-5b47-4346-bc75-b3e6c4075c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.004904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dcc5d-5b47-4346-bc75-b3e6c4075c34 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.005699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dcc5d-5b47-4346-bc75-b3e6c4075c34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:04.006015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dcc5d-5b47-4346-bc75-b3e6c4075c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:04.014485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dcc5d-5b47-4346-bc75-b3e6c4075c34 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:04.020487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 287/552] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:04.022674 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dcc5d-5b47-4346-bc75-b3e6c4075c34 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:04.129807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dcc5d-5b47-4346-bc75-b3e6c4075c34 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:04.143076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:04.159703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:04.166264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca621f-8173-4bd2-91be-87948df6d8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:04.166882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca621f-8173-4bd2-91be-87948df6d8ec None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.167201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca621f-8173-4bd2-91be-87948df6d8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.167561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca621f-8173-4bd2-91be-87948df6d8ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.182462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987923bf-15c5-4666-b9ac-887d54a56a82 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:04.182623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca621f-8173-4bd2-91be-87948df6d8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:04.182623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca621f-8173-4bd2-91be-87948df6d8ec None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-95ca621f-8173-4bd2-91be-87948df6d8ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:04.198484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:04.199407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:04.200344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:04.200344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:04.200344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:04.200344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:04.201565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 288/553] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:04.202639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca621f-8173-4bd2-91be-87948df6d8ec None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:04.261470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407cd39-784f-4eaf-b9bc-a206cb3c03fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:04.262104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407cd39-784f-4eaf-b9bc-a206cb3c03fe None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.262383 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407cd39-784f-4eaf-b9bc-a206cb3c03fe None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.262719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407cd39-784f-4eaf-b9bc-a206cb3c03fe None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.263492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407cd39-784f-4eaf-b9bc-a206cb3c03fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:04.263798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407cd39-784f-4eaf-b9bc-a206cb3c03fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:04.265247 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407cd39-784f-4eaf-b9bc-a206cb3c03fe None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:04.308436 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 266/554] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jul 28 01:56:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:04.309952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8243-fcff-410f-b9c8-fb2f1430faa7 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.310242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8243-fcff-410f-b9c8-fb2f1430faa7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.311321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8243-fcff-410f-b9c8-fb2f1430faa7 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.312829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 267/555] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:04.317405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db8243-fcff-410f-b9c8-fb2f1430faa7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:04.351395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca621f-8173-4bd2-91be-87948df6d8ec None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:04.395199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2a3a4-a809-4440-80e6-d1b5011babd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:04.396105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2a3a4-a809-4440-80e6-d1b5011babd0 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.396385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2a3a4-a809-4440-80e6-d1b5011babd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.396803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2a3a4-a809-4440-80e6-d1b5011babd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.397827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2a3a4-a809-4440-80e6-d1b5011babd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:04.398151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2a3a4-a809-4440-80e6-d1b5011babd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:04.399874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2a3a4-a809-4440-80e6-d1b5011babd0 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:04.419756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 289/556] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:04.421021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d50c5-776b-4c74-a225-afa7aff11f18 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.421313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d50c5-776b-4c74-a225-afa7aff11f18 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.421591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d50c5-776b-4c74-a225-afa7aff11f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.444057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db8243-fcff-410f-b9c8-fb2f1430faa7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:04.445345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e81d50c5-776b-4c74-a225-afa7aff11f18 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:04.446600 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e81d50c5-776b-4c74-a225-afa7aff11f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:04.465422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:04.484481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d4456-2a5e-48bf-8f07-bccab9812cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:04.485764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d4456-2a5e-48bf-8f07-bccab9812cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.486237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d4456-2a5e-48bf-8f07-bccab9812cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.486823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d4456-2a5e-48bf-8f07-bccab9812cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.506682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:04.520698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 290/557] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:04.521685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d50c5-776b-4c74-a225-afa7aff11f18 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:04.560136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d4456-2a5e-48bf-8f07-bccab9812cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:04.561973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d4456-2a5e-48bf-8f07-bccab9812cb7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:04.628540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d50c5-776b-4c74-a225-afa7aff11f18 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:04.666008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb8c07-4732-4c2e-865d-83dffac53e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:04.666679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb8c07-4732-4c2e-865d-83dffac53e09 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.666958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb8c07-4732-4c2e-865d-83dffac53e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.667229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb8c07-4732-4c2e-865d-83dffac53e09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.668053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 268/558] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:04.669107 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d4456-2a5e-48bf-8f07-bccab9812cb7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:04.675381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb8c07-4732-4c2e-865d-83dffac53e09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:04.676786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb8c07-4732-4c2e-865d-83dffac53e09 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-89eb8c07-4732-4c2e-865d-83dffac53e09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:04.689191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:04.690645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 291/559] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jul 28 01:56:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:04.691825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb8c07-4732-4c2e-865d-83dffac53e09 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:04.708389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:04.725814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:04.779332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d4456-2a5e-48bf-8f07-bccab9812cb7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:04.799280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb8c07-4732-4c2e-865d-83dffac53e09 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:04.816400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f96a-4cfc-4a94-ab53-080bfa044339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:04.817478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f96a-4cfc-4a94-ab53-080bfa044339 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.818224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f96a-4cfc-4a94-ab53-080bfa044339 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.818724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f96a-4cfc-4a94-ab53-080bfa044339 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.832310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01f96a-4cfc-4a94-ab53-080bfa044339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:04.834648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b73171-6077-404c-a126-e6591643c996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:04.835272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73171-6077-404c-a126-e6591643c996 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.835552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73171-6077-404c-a126-e6591643c996 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.835820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73171-6077-404c-a126-e6591643c996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3e01f96a-4cfc-4a94-ab53-080bfa044339 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:04.839217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:04.840174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:04.840974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:04.841594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 269/560] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:04.842157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f96a-4cfc-4a94-ab53-080bfa044339 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:04.846411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b73171-6077-404c-a126-e6591643c996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:04.847887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b73171-6077-404c-a126-e6591643c996 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-72b73171-6077-404c-a126-e6591643c996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:04.862413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:04.863378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:04.864318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:04.864318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:04.864318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:04.864318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:04.864318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 292/561] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:04.865018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095993c-6d0c-4f4d-8d23-0206d11a37f6 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:04.865018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095993c-6d0c-4f4d-8d23-0206d11a37f6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:04.865256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095993c-6d0c-4f4d-8d23-0206d11a37f6 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:04.866654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 293/562] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:04.867200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095993c-6d0c-4f4d-8d23-0206d11a37f6 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:04.936985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:04.968474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f96a-4cfc-4a94-ab53-080bfa044339 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:04.974172 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095993c-6d0c-4f4d-8d23-0206d11a37f6 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:04.979767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:05.006033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ba79b-3376-4b08-b70f-d90d3b0cc448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.006763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ba79b-3376-4b08-b70f-d90d3b0cc448 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.007043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ba79b-3376-4b08-b70f-d90d3b0cc448 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.007313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ba79b-3376-4b08-b70f-d90d3b0cc448 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.008101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ba79b-3376-4b08-b70f-d90d3b0cc448 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:05.008461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ba79b-3376-4b08-b70f-d90d3b0cc448 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:05.009443 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a100b-8a07-46d5-8453-250ef7004774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.009933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ba79b-3376-4b08-b70f-d90d3b0cc448 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:05.010045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a100b-8a07-46d5-8453-250ef7004774 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.010316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a100b-8a07-46d5-8453-250ef7004774 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.010620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a100b-8a07-46d5-8453-250ef7004774 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.011339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a100b-8a07-46d5-8453-250ef7004774 None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:05.011643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a100b-8a07-46d5-8453-250ef7004774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:05.012991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a100b-8a07-46d5-8453-250ef7004774 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:05.021158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 294/563] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:05.021957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a100b-8a07-46d5-8453-250ef7004774 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.029526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 270/564] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jul 28 01:56:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:05.030776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0cc19-446f-4a6c-98ab-305d43902def None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.031057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0cc19-446f-4a6c-98ab-305d43902def None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.031331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0cc19-446f-4a6c-98ab-305d43902def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.049789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-32a0cc19-446f-4a6c-98ab-305d43902def None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:05.051067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-32a0cc19-446f-4a6c-98ab-305d43902def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:05.122959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 271/565] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:05.123800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0cc19-446f-4a6c-98ab-305d43902def None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.144194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a100b-8a07-46d5-8453-250ef7004774 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:05.171637 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:05.179885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a76427-6553-4f00-897f-5179bc29adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.180558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a76427-6553-4f00-897f-5179bc29adcd None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.180836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a76427-6553-4f00-897f-5179bc29adcd None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.181109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a76427-6553-4f00-897f-5179bc29adcd None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.181869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a76427-6553-4f00-897f-5179bc29adcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:05.182176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a76427-6553-4f00-897f-5179bc29adcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:05.183586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a76427-6553-4f00-897f-5179bc29adcd None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:05.195769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 295/566] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:05.196366 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a76427-6553-4f00-897f-5179bc29adcd None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.242863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:05.248345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0cc19-446f-4a6c-98ab-305d43902def None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:05.283832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9114048-07ed-44a6-abc2-74b542a10031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.284466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114048-07ed-44a6-abc2-74b542a10031 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.284745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114048-07ed-44a6-abc2-74b542a10031 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.285016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114048-07ed-44a6-abc2-74b542a10031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.295956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9114048-07ed-44a6-abc2-74b542a10031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:05.297422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9114048-07ed-44a6-abc2-74b542a10031 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:05.301585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a76427-6553-4f00-897f-5179bc29adcd None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f9114048-07ed-44a6-abc2-74b542a10031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:05.311733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:05.312609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:05.313486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:05.313486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:05.313486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:05.313486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:05.313486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 272/567] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:05.313781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9114048-07ed-44a6-abc2-74b542a10031 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.341590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415da42-6761-4e49-abc9-9f75124d43d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.342247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415da42-6761-4e49-abc9-9f75124d43d2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.342553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415da42-6761-4e49-abc9-9f75124d43d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.342825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415da42-6761-4e49-abc9-9f75124d43d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.353676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415da42-6761-4e49-abc9-9f75124d43d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:05.355150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415da42-6761-4e49-abc9-9f75124d43d2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-4415da42-6761-4e49-abc9-9f75124d43d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:05.370481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:05.371407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:05.372314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:05.372314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:05.372314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:05.372314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:05.372314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 296/568] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:05.373194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415da42-6761-4e49-abc9-9f75124d43d2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.417077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:05.426044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9114048-07ed-44a6-abc2-74b542a10031 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:05.464305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12307e-8501-41c0-a3de-79f0ceeb1198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.464871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12307e-8501-41c0-a3de-79f0ceeb1198 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.465148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12307e-8501-41c0-a3de-79f0ceeb1198 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.465603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12307e-8501-41c0-a3de-79f0ceeb1198 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.479579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12307e-8501-41c0-a3de-79f0ceeb1198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:05.480476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415da42-6761-4e49-abc9-9f75124d43d2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6c12307e-8501-41c0-a3de-79f0ceeb1198 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:05.486031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:05.487288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:05.488132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 273/569] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:05.488846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12307e-8501-41c0-a3de-79f0ceeb1198 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.505638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:05.518763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50e68f-d61b-4918-b547-abf6755a75b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.519398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50e68f-d61b-4918-b547-abf6755a75b0 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.519793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50e68f-d61b-4918-b547-abf6755a75b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.520066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50e68f-d61b-4918-b547-abf6755a75b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.527411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50e68f-d61b-4918-b547-abf6755a75b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:05.528981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50e68f-d61b-4918-b547-abf6755a75b0 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-db50e68f-d61b-4918-b547-abf6755a75b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:05.541005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:05.541907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:05.542801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:05.542801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:05.542801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:05.542801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:05.542801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:05.542801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:05.542801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:05.542801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:05.542801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 297/570] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:05.543354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50e68f-d61b-4918-b547-abf6755a75b0 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.605717 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12307e-8501-41c0-a3de-79f0ceeb1198 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:05.645139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232954a2-020f-4388-a64b-840cc028b7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.645755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232954a2-020f-4388-a64b-840cc028b7fc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.646259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232954a2-020f-4388-a64b-840cc028b7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.646409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232954a2-020f-4388-a64b-840cc028b7fc None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.646872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:05.647302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232954a2-020f-4388-a64b-840cc028b7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:05.647302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232954a2-020f-4388-a64b-840cc028b7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:05.648724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232954a2-020f-4388-a64b-840cc028b7fc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:05.650640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50e68f-d61b-4918-b547-abf6755a75b0 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:05.665948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 274/571] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:05.665948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232954a2-020f-4388-a64b-840cc028b7fc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.692178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062726e-1de4-4505-8ad6-fe6c3f5d2dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.692882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062726e-1de4-4505-8ad6-fe6c3f5d2dfe None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.693223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062726e-1de4-4505-8ad6-fe6c3f5d2dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.693490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062726e-1de4-4505-8ad6-fe6c3f5d2dfe None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.694178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062726e-1de4-4505-8ad6-fe6c3f5d2dfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:05.694564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062726e-1de4-4505-8ad6-fe6c3f5d2dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:05.695931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062726e-1de4-4505-8ad6-fe6c3f5d2dfe None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:05.708554 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 298/572] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:05.709343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062726e-1de4-4505-8ad6-fe6c3f5d2dfe None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.741580 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:05.784278 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232954a2-020f-4388-a64b-840cc028b7fc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:05.820932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062726e-1de4-4505-8ad6-fe6c3f5d2dfe None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:05.826330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aa09c-8d8d-4875-8ea1-2f0ccc8fc750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.826981 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa09c-8d8d-4875-8ea1-2f0ccc8fc750 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.827264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa09c-8d8d-4875-8ea1-2f0ccc8fc750 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.827537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa09c-8d8d-4875-8ea1-2f0ccc8fc750 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.828252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aa09c-8d8d-4875-8ea1-2f0ccc8fc750 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:05.828644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aa09c-8d8d-4875-8ea1-2f0ccc8fc750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:05.830431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aa09c-8d8d-4875-8ea1-2f0ccc8fc750 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:05.842496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 275/573] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:05.842496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aa09c-8d8d-4875-8ea1-2f0ccc8fc750 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.865984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f2a3f-c8c1-4009-949c-ae2c99340150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.866640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2a3f-c8c1-4009-949c-ae2c99340150 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.867078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2a3f-c8c1-4009-949c-ae2c99340150 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.867355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2a3f-c8c1-4009-949c-ae2c99340150 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.868211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f2a3f-c8c1-4009-949c-ae2c99340150 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:05.868521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f2a3f-c8c1-4009-949c-ae2c99340150 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:05.869955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f2a3f-c8c1-4009-949c-ae2c99340150 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:05.888405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 299/574] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:05.888405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f2a3f-c8c1-4009-949c-ae2c99340150 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:05.913186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:05.954161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aa09c-8d8d-4875-8ea1-2f0ccc8fc750 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:05.984374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:05.991054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fc899-4538-432c-b1f2-fea043bb1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:05.991759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fc899-4538-432c-b1f2-fea043bb1618 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:05.991979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fc899-4538-432c-b1f2-fea043bb1618 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:05.992250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fc899-4538-432c-b1f2-fea043bb1618 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:05.998881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f2a3f-c8c1-4009-949c-ae2c99340150 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:06.000884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fc899-4538-432c-b1f2-fea043bb1618 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:06.002313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fc899-4538-432c-b1f2-fea043bb1618 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7f1fc899-4538-432c-b1f2-fea043bb1618 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:06.013449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:06.014741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 276/575] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:06.015688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fc899-4538-432c-b1f2-fea043bb1618 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.035511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85657e21-9d68-4d9f-81e8-46b1caeecb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:06.036145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85657e21-9d68-4d9f-81e8-46b1caeecb28 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.036426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85657e21-9d68-4d9f-81e8-46b1caeecb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.036701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85657e21-9d68-4d9f-81e8-46b1caeecb28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.043805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85657e21-9d68-4d9f-81e8-46b1caeecb28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:06.045259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85657e21-9d68-4d9f-81e8-46b1caeecb28 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-85657e21-9d68-4d9f-81e8-46b1caeecb28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:06.056498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:06.057385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:06.058267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:06.058267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:06.058267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:06.058267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:06.058267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:06.058267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:06.058267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:06.058267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:06.058267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 300/576] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:06.058793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85657e21-9d68-4d9f-81e8-46b1caeecb28 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.118094 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fc899-4538-432c-b1f2-fea043bb1618 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:06.145276 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:06.151890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067fb12-a1de-48e4-a406-3d55572d7a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:06.152551 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067fb12-a1de-48e4-a406-3d55572d7a92 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.152829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067fb12-a1de-48e4-a406-3d55572d7a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.153099 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067fb12-a1de-48e4-a406-3d55572d7a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.163463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067fb12-a1de-48e4-a406-3d55572d7a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:06.165448 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067fb12-a1de-48e4-a406-3d55572d7a92 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:06.165676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85657e21-9d68-4d9f-81e8-46b1caeecb28 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c067fb12-a1de-48e4-a406-3d55572d7a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:06.179261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:06.180289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:06.181413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:06.181413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:06.181413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:06.181413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:06.181413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 277/577] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:06.181862 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ec7cb-790d-425f-9c3c-a44153b376ee None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.182149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ec7cb-790d-425f-9c3c-a44153b376ee None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.182424 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ec7cb-790d-425f-9c3c-a44153b376ee None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.186468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 278/578] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:06.186468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ec7cb-790d-425f-9c3c-a44153b376ee None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.202742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a49dd6-e946-4084-b487-eebcf941805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:06.203349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a49dd6-e946-4084-b487-eebcf941805f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.203622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a49dd6-e946-4084-b487-eebcf941805f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.203889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a49dd6-e946-4084-b487-eebcf941805f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.204671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a49dd6-e946-4084-b487-eebcf941805f None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=a891bb14f40d403b90915115bc487b03) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:06.204976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a49dd6-e946-4084-b487-eebcf941805f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:06.206470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a49dd6-e946-4084-b487-eebcf941805f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:06.212359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 301/579] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:06 2022] GET /identity/v3/role_assignments?user.id=a891bb14f40d403b90915115bc487b03&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:06.213231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a49dd6-e946-4084-b487-eebcf941805f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.235828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:06.302116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ec7cb-790d-425f-9c3c-a44153b376ee None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:06.340110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a49dd6-e946-4084-b487-eebcf941805f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:06.341391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426e547-0a1c-4ade-ab69-a297839f1be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:06.342165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e547-0a1c-4ade-ab69-a297839f1be3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.342598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e547-0a1c-4ade-ab69-a297839f1be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.342967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e547-0a1c-4ade-ab69-a297839f1be3 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.343888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426e547-0a1c-4ade-ab69-a297839f1be3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:06.344301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426e547-0a1c-4ade-ab69-a297839f1be3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:06.345870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426e547-0a1c-4ade-ab69-a297839f1be3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:06.371637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 279/580] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jul 28 01:56:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:06.371637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426e547-0a1c-4ade-ab69-a297839f1be3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.379023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ea232-ae47-4d73-8120-b8873eebe639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:06.379981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ea232-ae47-4d73-8120-b8873eebe639 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.380404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ea232-ae47-4d73-8120-b8873eebe639 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.380818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ea232-ae47-4d73-8120-b8873eebe639 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.382140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ea232-ae47-4d73-8120-b8873eebe639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:06.382743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ea232-ae47-4d73-8120-b8873eebe639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:06.385285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ea232-ae47-4d73-8120-b8873eebe639 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:06.404452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 302/581] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:06.404452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd769-ab7b-4ed9-b755-fc84d70a7606 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.404452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd769-ab7b-4ed9-b755-fc84d70a7606 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.404452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd769-ab7b-4ed9-b755-fc84d70a7606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.410569 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:06.422882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-fe1cd769-ab7b-4ed9-b755-fc84d70a7606 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:06.424158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fe1cd769-ab7b-4ed9-b755-fc84d70a7606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:06.497075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426e547-0a1c-4ade-ab69-a297839f1be3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:06.498691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:06.520168 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 303/582] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:06.521407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cd769-ab7b-4ed9-b755-fc84d70a7606 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.539442 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616c325-6e5b-4ab6-8545-e7ab8f3bbef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:06.540922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616c325-6e5b-4ab6-8545-e7ab8f3bbef2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.541201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616c325-6e5b-4ab6-8545-e7ab8f3bbef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.541469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616c325-6e5b-4ab6-8545-e7ab8f3bbef2 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.542160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616c325-6e5b-4ab6-8545-e7ab8f3bbef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:06.542489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616c325-6e5b-4ab6-8545-e7ab8f3bbef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:06.543898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616c325-6e5b-4ab6-8545-e7ab8f3bbef2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:06.557047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 280/583] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:06.558198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616c325-6e5b-4ab6-8545-e7ab8f3bbef2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.631499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cd769-ab7b-4ed9-b755-fc84d70a7606 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:06.666692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1e9a9-c43c-488e-af3a-cd88e218eb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:06.667996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1e9a9-c43c-488e-af3a-cd88e218eb88 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.668279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1e9a9-c43c-488e-af3a-cd88e218eb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.668551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1e9a9-c43c-488e-af3a-cd88e218eb88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.670469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:06.673476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616c325-6e5b-4ab6-8545-e7ab8f3bbef2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:06.681124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1e9a9-c43c-488e-af3a-cd88e218eb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:06.683596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1e9a9-c43c-488e-af3a-cd88e218eb88 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-bbe1e9a9-c43c-488e-af3a-cd88e218eb88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:06.701219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:06.702102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:06.703019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:06.703019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:06.703019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:06.703019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:06.703857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 304/584] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:06.704652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1e9a9-c43c-488e-af3a-cd88e218eb88 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.711851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1346c-af19-4322-b65c-ed9d8a092bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:06.712789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1346c-af19-4322-b65c-ed9d8a092bdd None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.713264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1346c-af19-4322-b65c-ed9d8a092bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.713742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1346c-af19-4322-b65c-ed9d8a092bdd None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/b9f911e716994f1f9d4705216ee0f3a5/roles/d8f52393c9554176af3cc338302d1302` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.728348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1346c-af19-4322-b65c-ed9d8a092bdd None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=b9f911e716994f1f9d4705216ee0f3a5, role_id=d8f52393c9554176af3cc338302d1302)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:06.730020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1346c-af19-4322-b65c-ed9d8a092bdd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:06.744391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 281/585] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:56:06 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/b9f911e716994f1f9d4705216ee0f3a5/roles/d8f52393c9554176af3cc338302d1302 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:56:06.745508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1346c-af19-4322-b65c-ed9d8a092bdd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.763149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:06.861792 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1e9a9-c43c-488e-af3a-cd88e218eb88 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:06.880893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1346c-af19-4322-b65c-ed9d8a092bdd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:06.910931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6410-67ac-4b7d-b727-7ed23fc57744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:06.911632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6410-67ac-4b7d-b727-7ed23fc57744 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.911912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6410-67ac-4b7d-b727-7ed23fc57744 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.912182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6410-67ac-4b7d-b727-7ed23fc57744 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.924634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c6410-67ac-4b7d-b727-7ed23fc57744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-211c6410-67ac-4b7d-b727-7ed23fc57744 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:06.931980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:06.933098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 305/586] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:06.934121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6410-67ac-4b7d-b727-7ed23fc57744 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.944184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61394c5c-fe78-4993-b110-5525c940302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:06.945139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61394c5c-fe78-4993-b110-5525c940302d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:06.945589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61394c5c-fe78-4993-b110-5525c940302d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:06.945865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61394c5c-fe78-4993-b110-5525c940302d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:06.957622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61394c5c-fe78-4993-b110-5525c940302d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:06.959397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61394c5c-fe78-4993-b110-5525c940302d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-61394c5c-fe78-4993-b110-5525c940302d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:06.976556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:06.977791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:06.979262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 282/587] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:06.980187 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61394c5c-fe78-4993-b110-5525c940302d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:06.997186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:07.061782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6410-67ac-4b7d-b727-7ed23fc57744 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:07.070139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:07.104217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee015f-7696-4f9c-9aab-cbf011b28c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:07.104967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee015f-7696-4f9c-9aab-cbf011b28c4b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:07.105258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee015f-7696-4f9c-9aab-cbf011b28c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:07.105535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee015f-7696-4f9c-9aab-cbf011b28c4b None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:07.106534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee015f-7696-4f9c-9aab-cbf011b28c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:07.107257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee015f-7696-4f9c-9aab-cbf011b28c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:07.108900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee015f-7696-4f9c-9aab-cbf011b28c4b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:07.109917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61394c5c-fe78-4993-b110-5525c940302d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:07.126601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 306/588] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:07.127402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee015f-7696-4f9c-9aab-cbf011b28c4b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:07.163069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386ee7f-b148-4834-a5df-e075a519c2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:07.164105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386ee7f-b148-4834-a5df-e075a519c2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:07.164652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386ee7f-b148-4834-a5df-e075a519c2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:07.165471 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386ee7f-b148-4834-a5df-e075a519c2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:07.166201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386ee7f-b148-4834-a5df-e075a519c2f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:07.166532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386ee7f-b148-4834-a5df-e075a519c2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:07.169034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386ee7f-b148-4834-a5df-e075a519c2f1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:07.179583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 283/589] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:07.181393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386ee7f-b148-4834-a5df-e075a519c2f1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:07.251127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee015f-7696-4f9c-9aab-cbf011b28c4b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:07.260911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:07.290751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4502305-b8ef-44a0-87ae-59f73ded8bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:07.291579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4502305-b8ef-44a0-87ae-59f73ded8bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:07.291933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4502305-b8ef-44a0-87ae-59f73ded8bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:07.292280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4502305-b8ef-44a0-87ae-59f73ded8bc8 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:07.293158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4502305-b8ef-44a0-87ae-59f73ded8bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:07.293538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4502305-b8ef-44a0-87ae-59f73ded8bc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:07.295455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4502305-b8ef-44a0-87ae-59f73ded8bc8 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:07.321167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386ee7f-b148-4834-a5df-e075a519c2f1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:07.321952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 307/590] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jul 28 01:56:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:07.322907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4502305-b8ef-44a0-87ae-59f73ded8bc8 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:07.365738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf55b08-645c-442c-ba8d-81b5d83632a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:07.366527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf55b08-645c-442c-ba8d-81b5d83632a8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:07.366850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf55b08-645c-442c-ba8d-81b5d83632a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:07.367120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf55b08-645c-442c-ba8d-81b5d83632a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:07.372027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:07.378901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf55b08-645c-442c-ba8d-81b5d83632a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:07.381409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf55b08-645c-442c-ba8d-81b5d83632a8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1cf55b08-645c-442c-ba8d-81b5d83632a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:07.397768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:07.398926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:07.400018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:07.400018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:07.400018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:07.400018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:07.400018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:07.400018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:07.400018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:07.400018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:07.400018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 284/591] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:07.400018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf55b08-645c-442c-ba8d-81b5d83632a8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:07.443957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4502305-b8ef-44a0-87ae-59f73ded8bc8 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:07.482862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5b29-adfc-4a6d-b99c-a18fac23abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:07.483766 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5b29-adfc-4a6d-b99c-a18fac23abc3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:07.484209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5b29-adfc-4a6d-b99c-a18fac23abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:07.484646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5b29-adfc-4a6d-b99c-a18fac23abc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:07.496197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c5b29-adfc-4a6d-b99c-a18fac23abc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:07.497821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c5b29-adfc-4a6d-b99c-a18fac23abc3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-fd4c5b29-adfc-4a6d-b99c-a18fac23abc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:07.513235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:07.514330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:07.515300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:07.515300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:07.515300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:07.515300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:07.517278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 308/592] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:07.518244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5b29-adfc-4a6d-b99c-a18fac23abc3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:07.537305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf55b08-645c-442c-ba8d-81b5d83632a8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:07.544479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:07.575518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6454c-377a-4b76-9eab-38298ba13472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:07.576481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6454c-377a-4b76-9eab-38298ba13472 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:07.577003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6454c-377a-4b76-9eab-38298ba13472 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:07.577478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6454c-377a-4b76-9eab-38298ba13472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:07.588781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6454c-377a-4b76-9eab-38298ba13472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:07.591045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6454c-377a-4b76-9eab-38298ba13472 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-99d6454c-377a-4b76-9eab-38298ba13472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:07.609977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:07.610903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:07.611788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:07.611788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:07.611788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:07.611788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:07.611788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 285/593] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:07.616787 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6454c-377a-4b76-9eab-38298ba13472 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:07.650779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5b29-adfc-4a6d-b99c-a18fac23abc3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:07.670033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:07.699017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de635466-e335-49cb-9269-933c7c25b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:07.699650 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de635466-e335-49cb-9269-933c7c25b133 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:07.699904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de635466-e335-49cb-9269-933c7c25b133 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:07.700172 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de635466-e335-49cb-9269-933c7c25b133 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:07.700914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de635466-e335-49cb-9269-933c7c25b133 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:07.701217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de635466-e335-49cb-9269-933c7c25b133 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:07.702677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de635466-e335-49cb-9269-933c7c25b133 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:07.724691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 309/594] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:07.724691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de635466-e335-49cb-9269-933c7c25b133 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:07.737598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6454c-377a-4b76-9eab-38298ba13472 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:07.774044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84ff53-4b2a-4212-9780-4307f2509304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:07.775502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ff53-4b2a-4212-9780-4307f2509304 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:07.776374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ff53-4b2a-4212-9780-4307f2509304 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:07.777125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ff53-4b2a-4212-9780-4307f2509304 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:07.778215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84ff53-4b2a-4212-9780-4307f2509304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:07.778820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84ff53-4b2a-4212-9780-4307f2509304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:07.781480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84ff53-4b2a-4212-9780-4307f2509304 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:07.796931 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 286/595] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:07.798169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84ff53-4b2a-4212-9780-4307f2509304 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:07.836159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:07.876308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de635466-e335-49cb-9269-933c7c25b133 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:07.922773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84ff53-4b2a-4212-9780-4307f2509304 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:07.927327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7431c-60e2-4cbd-89c9-0e3fd32486da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:07.928246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7431c-60e2-4cbd-89c9-0e3fd32486da None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:07.928720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7431c-60e2-4cbd-89c9-0e3fd32486da None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:07.929185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7431c-60e2-4cbd-89c9-0e3fd32486da None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:07.930091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7431c-60e2-4cbd-89c9-0e3fd32486da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:07.931111 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:07.931901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7431c-60e2-4cbd-89c9-0e3fd32486da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:07.933942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7431c-60e2-4cbd-89c9-0e3fd32486da None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:07.955860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 310/596] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:07.956869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7431c-60e2-4cbd-89c9-0e3fd32486da None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:07.963912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1425587-d60f-4615-acc7-05cfd0966818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:07.964854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1425587-d60f-4615-acc7-05cfd0966818 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:07.965307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1425587-d60f-4615-acc7-05cfd0966818 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:07.965751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1425587-d60f-4615-acc7-05cfd0966818 None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/ece4e0b16a9441b5ba14bbc8ff1c632c/roles/d8f52393c9554176af3cc338302d1302` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:07.986487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1425587-d60f-4615-acc7-05cfd0966818 None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=ece4e0b16a9441b5ba14bbc8ff1c632c, role_id=d8f52393c9554176af3cc338302d1302)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:07.989318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1425587-d60f-4615-acc7-05cfd0966818 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:08.008036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 287/597] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:56:07 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/ece4e0b16a9441b5ba14bbc8ff1c632c/roles/d8f52393c9554176af3cc338302d1302 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:56:08.009801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1425587-d60f-4615-acc7-05cfd0966818 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:08.137036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1425587-d60f-4615-acc7-05cfd0966818 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:08.156722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7431c-60e2-4cbd-89c9-0e3fd32486da None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:08.180124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9710b6-ab89-43ac-9f05-ebac75d6ab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:08.181626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9710b6-ab89-43ac-9f05-ebac75d6ab6e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.182344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9710b6-ab89-43ac-9f05-ebac75d6ab6e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.182845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9710b6-ab89-43ac-9f05-ebac75d6ab6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.192373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9710b6-ab89-43ac-9f05-ebac75d6ab6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:08.194522 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9710b6-ab89-43ac-9f05-ebac75d6ab6e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-2f9710b6-ab89-43ac-9f05-ebac75d6ab6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:08.209466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:08.210462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:08.211359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:08.211359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:08.211359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:08.211359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:08.211359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:08.211359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:08.211359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:08.211359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:08.213614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 288/598] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:08.220708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9710b6-ab89-43ac-9f05-ebac75d6ab6e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:08.236385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fd7d9-3f1e-4a1d-9aef-1e72af0ba326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:08.237357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fd7d9-3f1e-4a1d-9aef-1e72af0ba326 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.237635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fd7d9-3f1e-4a1d-9aef-1e72af0ba326 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.237912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fd7d9-3f1e-4a1d-9aef-1e72af0ba326 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.241971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:08.243368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:08.249231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fd7d9-3f1e-4a1d-9aef-1e72af0ba326 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:08.251398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fd7d9-3f1e-4a1d-9aef-1e72af0ba326 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-ab0fd7d9-3f1e-4a1d-9aef-1e72af0ba326 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:08.266550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:08.267800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:08.268873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 311/599] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:08.269469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228faaf-aa7c-4ee8-8e39-e88df50b12d5 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.269469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228faaf-aa7c-4ee8-8e39-e88df50b12d5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.269611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228faaf-aa7c-4ee8-8e39-e88df50b12d5 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.276213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 312/600] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:08.277149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228faaf-aa7c-4ee8-8e39-e88df50b12d5 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:08.357092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9710b6-ab89-43ac-9f05-ebac75d6ab6e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:08.397622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228faaf-aa7c-4ee8-8e39-e88df50b12d5 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:08.400476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3194f5-e941-407a-b661-bbe84af5612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:08.402163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3194f5-e941-407a-b661-bbe84af5612d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.402625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3194f5-e941-407a-b661-bbe84af5612d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.403035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3194f5-e941-407a-b661-bbe84af5612d None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.403926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3194f5-e941-407a-b661-bbe84af5612d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:08.404394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3194f5-e941-407a-b661-bbe84af5612d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:08.406428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3194f5-e941-407a-b661-bbe84af5612d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:08.422112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 289/601] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:08.423732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e7e61-ca12-43ef-b762-1cb137aee855 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.424154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e7e61-ca12-43ef-b762-1cb137aee855 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.424567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e7e61-ca12-43ef-b762-1cb137aee855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.444885 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0b8e7e61-ca12-43ef-b762-1cb137aee855 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:08.446255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0b8e7e61-ca12-43ef-b762-1cb137aee855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:08.447705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2d9eb-0d77-41a2-8a32-08bafd99666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:08.448665 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2d9eb-0d77-41a2-8a32-08bafd99666b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.449139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2d9eb-0d77-41a2-8a32-08bafd99666b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.450353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2d9eb-0d77-41a2-8a32-08bafd99666b None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.451345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2d9eb-0d77-41a2-8a32-08bafd99666b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:08.451798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2d9eb-0d77-41a2-8a32-08bafd99666b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:08.453377 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2d9eb-0d77-41a2-8a32-08bafd99666b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:08.477561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 313/602] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Jul 28 01:56:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:08.478765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2d9eb-0d77-41a2-8a32-08bafd99666b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:08.532251 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 290/603] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:08.533900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e7e61-ca12-43ef-b762-1cb137aee855 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:08.548011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:08.553620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:08.601695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2d9eb-0d77-41a2-8a32-08bafd99666b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:08.639559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0b20b-c081-48ae-b957-8c587e41d73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:08.640229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b20b-c081-48ae-b957-8c587e41d73d None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.640568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b20b-c081-48ae-b957-8c587e41d73d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.640845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b20b-c081-48ae-b957-8c587e41d73d None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/983bd6880830419f9158b33411b57f04/roles/d8f52393c9554176af3cc338302d1302` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.654547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e7e61-ca12-43ef-b762-1cb137aee855 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:08.655439 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0b20b-c081-48ae-b957-8c587e41d73d None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=983bd6880830419f9158b33411b57f04, role_id=d8f52393c9554176af3cc338302d1302)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:08.656971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0b20b-c081-48ae-b957-8c587e41d73d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:08.678836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 314/604] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:56:08 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/983bd6880830419f9158b33411b57f04/roles/d8f52393c9554176af3cc338302d1302 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:56:08.679867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0b20b-c081-48ae-b957-8c587e41d73d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:08.705276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec7c0a-5d9d-4d1a-924d-2290ef6cbbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:08.706218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec7c0a-5d9d-4d1a-924d-2290ef6cbbab None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.706933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec7c0a-5d9d-4d1a-924d-2290ef6cbbab None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.708147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec7c0a-5d9d-4d1a-924d-2290ef6cbbab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.732701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec7c0a-5d9d-4d1a-924d-2290ef6cbbab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:08.735645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec7c0a-5d9d-4d1a-924d-2290ef6cbbab None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ccec7c0a-5d9d-4d1a-924d-2290ef6cbbab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:08.770625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:08.771727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:08.772819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:08.772819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:08.772819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:08.772819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:08.774610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 291/605] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:08.782496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec7c0a-5d9d-4d1a-924d-2290ef6cbbab None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:08.879318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:08.882909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0b20b-c081-48ae-b957-8c587e41d73d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:08.889662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:08.936938 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c941265-6d65-4684-8d2d-15c1d9b85f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:08.937971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941265-6d65-4684-8d2d-15c1d9b85f0a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.938516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941265-6d65-4684-8d2d-15c1d9b85f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.938803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941265-6d65-4684-8d2d-15c1d9b85f0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.940310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec7c0a-5d9d-4d1a-924d-2290ef6cbbab None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:08.952499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c941265-6d65-4684-8d2d-15c1d9b85f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-3c941265-6d65-4684-8d2d-15c1d9b85f0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:08.959307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:08.960413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:08.961444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:08.963973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 315/606] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:08.969256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90b913-0dc6-468f-80a1-198e2ecb2488 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.969256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90b913-0dc6-468f-80a1-198e2ecb2488 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.969256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90b913-0dc6-468f-80a1-198e2ecb2488 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.969256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 316/607] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:08.971289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90b913-0dc6-468f-80a1-198e2ecb2488 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:08.988314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de608385-6ebc-4338-a03e-a29dfda0505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:08.989024 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de608385-6ebc-4338-a03e-a29dfda0505d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:08.989380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de608385-6ebc-4338-a03e-a29dfda0505d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:08.989724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de608385-6ebc-4338-a03e-a29dfda0505d None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:08.990524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de608385-6ebc-4338-a03e-a29dfda0505d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:08.990904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de608385-6ebc-4338-a03e-a29dfda0505d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:08.992348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de608385-6ebc-4338-a03e-a29dfda0505d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:09.005664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 292/608] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:09.006997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ec8da-c151-42f7-9ae0-101312c9fb29 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:09.007380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ec8da-c151-42f7-9ae0-101312c9fb29 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:09.007693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ec8da-c151-42f7-9ae0-101312c9fb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:09.025980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cd5ec8da-c151-42f7-9ae0-101312c9fb29 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:09.027392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cd5ec8da-c151-42f7-9ae0-101312c9fb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:09.092765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90b913-0dc6-468f-80a1-198e2ecb2488 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:09.120878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 293/609] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:09.121973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ec8da-c151-42f7-9ae0-101312c9fb29 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:09.146205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3763cf-8c0a-4548-ad2a-01476d78a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:09.146991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3763cf-8c0a-4548-ad2a-01476d78a925 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:09.147351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3763cf-8c0a-4548-ad2a-01476d78a925 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:09.147701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3763cf-8c0a-4548-ad2a-01476d78a925 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:09.148499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3763cf-8c0a-4548-ad2a-01476d78a925 None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:09.148944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3763cf-8c0a-4548-ad2a-01476d78a925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:09.150901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3763cf-8c0a-4548-ad2a-01476d78a925 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:09.168852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 317/610] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:09.174354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3763cf-8c0a-4548-ad2a-01476d78a925 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:09.182592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:09.210947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:09.249211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ec8da-c151-42f7-9ae0-101312c9fb29 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:09.287520 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3763cf-8c0a-4548-ad2a-01476d78a925 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:09.293779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6deeb-5274-4e94-8a28-aa37196d7e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:09.294551 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6deeb-5274-4e94-8a28-aa37196d7e58 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:09.294908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6deeb-5274-4e94-8a28-aa37196d7e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:09.295258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6deeb-5274-4e94-8a28-aa37196d7e58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:09.303472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6deeb-5274-4e94-8a28-aa37196d7e58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:09.305182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6deeb-5274-4e94-8a28-aa37196d7e58 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-16a6deeb-5274-4e94-8a28-aa37196d7e58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:09.319746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:09.320887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:09.322585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:09.322585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:09.322585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:09.322585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:09.322585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:09.322585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:09.322585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:09.322585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:09.323945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 294/611] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:09.324901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6deeb-5274-4e94-8a28-aa37196d7e58 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:09.334051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ee299-78c0-443e-8ba9-e96057068a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:09.334985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ee299-78c0-443e-8ba9-e96057068a82 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:09.335402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ee299-78c0-443e-8ba9-e96057068a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:09.335814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ee299-78c0-443e-8ba9-e96057068a82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:09.350011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ee299-78c0-443e-8ba9-e96057068a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-858ee299-78c0-443e-8ba9-e96057068a82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:09.359046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:09.360163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:09.361180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:09.363305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 318/612] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:09.364467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ee299-78c0-443e-8ba9-e96057068a82 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:09.440602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6deeb-5274-4e94-8a28-aa37196d7e58 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:09.454384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:09.485232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3998b-f6e7-446c-8483-2c72b23d3e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:09.485945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3998b-f6e7-446c-8483-2c72b23d3e05 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:09.486320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3998b-f6e7-446c-8483-2c72b23d3e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:09.486820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3998b-f6e7-446c-8483-2c72b23d3e05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:09.488130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:09.502179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3998b-f6e7-446c-8483-2c72b23d3e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:09.503908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3998b-f6e7-446c-8483-2c72b23d3e05 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:09.508724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ee299-78c0-443e-8ba9-e96057068a82 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-47c3998b-f6e7-446c-8483-2c72b23d3e05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:09.520426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:09.521496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:09.522373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:09.522373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:09.522373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:09.522373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:09.527231 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 295/613] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:09.528240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3998b-f6e7-446c-8483-2c72b23d3e05 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:09.550760 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f951a9a-e065-4224-a4c6-9d31864d9150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:09.551615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f951a9a-e065-4224-a4c6-9d31864d9150 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:09.552068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f951a9a-e065-4224-a4c6-9d31864d9150 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:09.552920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f951a9a-e065-4224-a4c6-9d31864d9150 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:09.554201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f951a9a-e065-4224-a4c6-9d31864d9150 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:09.554716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f951a9a-e065-4224-a4c6-9d31864d9150 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:09.557398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f951a9a-e065-4224-a4c6-9d31864d9150 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:09.572992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 319/614] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:09.574349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f951a9a-e065-4224-a4c6-9d31864d9150 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:09.640822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3998b-f6e7-446c-8483-2c72b23d3e05 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:09.676776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f951a9a-e065-4224-a4c6-9d31864d9150 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:09.678255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69397a8d-16e8-4cf2-9a97-5ecf0b9aa974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:09.679105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69397a8d-16e8-4cf2-9a97-5ecf0b9aa974 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:09.679634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69397a8d-16e8-4cf2-9a97-5ecf0b9aa974 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:09.680669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69397a8d-16e8-4cf2-9a97-5ecf0b9aa974 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:09.680899 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69397a8d-16e8-4cf2-9a97-5ecf0b9aa974 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:09.681295 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69397a8d-16e8-4cf2-9a97-5ecf0b9aa974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:09.682952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69397a8d-16e8-4cf2-9a97-5ecf0b9aa974 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:09.692324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 296/615] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:09.693246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69397a8d-16e8-4cf2-9a97-5ecf0b9aa974 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:09.715315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca6a51-78db-43aa-bb23-ac018aef3b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:09.716210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca6a51-78db-43aa-bb23-ac018aef3b11 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:09.716663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca6a51-78db-43aa-bb23-ac018aef3b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:09.717132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca6a51-78db-43aa-bb23-ac018aef3b11 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:09.718002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca6a51-78db-43aa-bb23-ac018aef3b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:09.718539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca6a51-78db-43aa-bb23-ac018aef3b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:09.720129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca6a51-78db-43aa-bb23-ac018aef3b11 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:09.721357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:09.733757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 320/616] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:09.735205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca6a51-78db-43aa-bb23-ac018aef3b11 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:09.745396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:09.828000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69397a8d-16e8-4cf2-9a97-5ecf0b9aa974 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:09.846745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca6a51-78db-43aa-bb23-ac018aef3b11 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:09.877573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37365b-da57-4456-857f-1f3c49540e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:09.877866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37365b-da57-4456-857f-1f3c49540e5c None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:09.878102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37365b-da57-4456-857f-1f3c49540e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:09.878384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37365b-da57-4456-857f-1f3c49540e5c None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/50bf5763fbf94aa9b438a1be6ce88c58/roles/d8f52393c9554176af3cc338302d1302` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:09.890077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707bbe8-0b74-4fd4-ad47-24cbd966a3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:09.891568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bbe8-0b74-4fd4-ad47-24cbd966a3cd None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:09.892050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bbe8-0b74-4fd4-ad47-24cbd966a3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:09.892513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bbe8-0b74-4fd4-ad47-24cbd966a3cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:09.899953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37365b-da57-4456-857f-1f3c49540e5c None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=50bf5763fbf94aa9b438a1be6ce88c58, role_id=d8f52393c9554176af3cc338302d1302)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:09.901512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37365b-da57-4456-857f-1f3c49540e5c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:09.906625 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707bbe8-0b74-4fd4-ad47-24cbd966a3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:09.908164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707bbe8-0b74-4fd4-ad47-24cbd966a3cd None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:09.922518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 297/617] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:56:09 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/50bf5763fbf94aa9b438a1be6ce88c58/roles/d8f52393c9554176af3cc338302d1302 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:56:09.923889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37365b-da57-4456-857f-1f3c49540e5c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-d707bbe8-0b74-4fd4-ad47-24cbd966a3cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:09.924462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:09.925746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:09.927119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:09.927119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:09.927119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:09.927119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:09.927119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 321/618] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:09.931251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707bbe8-0b74-4fd4-ad47-24cbd966a3cd None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:09.997909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:10.025662 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:10.044931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707bbe8-0b74-4fd4-ad47-24cbd966a3cd None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:10.066233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37365b-da57-4456-857f-1f3c49540e5c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:10.082305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda0ade-e148-4f28-9f30-b932253b6f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:10.082962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda0ade-e148-4f28-9f30-b932253b6f9e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.083237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda0ade-e148-4f28-9f30-b932253b6f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.083519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda0ade-e148-4f28-9f30-b932253b6f9e None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.084376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda0ade-e148-4f28-9f30-b932253b6f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:10.084780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda0ade-e148-4f28-9f30-b932253b6f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:10.086205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda0ade-e148-4f28-9f30-b932253b6f9e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:10.100265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 322/619] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:10.110318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda0ade-e148-4f28-9f30-b932253b6f9e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:10.113773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d274706-b5cd-4478-a15b-070c33d0f7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:10.114950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274706-b5cd-4478-a15b-070c33d0f7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.115441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274706-b5cd-4478-a15b-070c33d0f7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.115918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274706-b5cd-4478-a15b-070c33d0f7f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.124857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d274706-b5cd-4478-a15b-070c33d0f7f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:10.126820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d274706-b5cd-4478-a15b-070c33d0f7f5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4d274706-b5cd-4478-a15b-070c33d0f7f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:10.144372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:10.145638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:10.146637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:10.146637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:10.146637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:10.146637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:10.146637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:10.146637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:10.146637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:10.146637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:10.146637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:10.146637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:10.149461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 298/620] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:10.155425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d274706-b5cd-4478-a15b-070c33d0f7f5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:10.282641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda0ade-e148-4f28-9f30-b932253b6f9e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:10.283270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d274706-b5cd-4478-a15b-070c33d0f7f5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:10.303267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:10.322150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:10.324552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4259a-598a-4cd6-88b0-e8dfd3d51b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:10.325296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4259a-598a-4cd6-88b0-e8dfd3d51b4b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.325575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4259a-598a-4cd6-88b0-e8dfd3d51b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.325843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4259a-598a-4cd6-88b0-e8dfd3d51b4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.329844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce6b88-f685-4d3d-985a-6a39992f555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:10.331154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce6b88-f685-4d3d-985a-6a39992f555c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.331939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce6b88-f685-4d3d-985a-6a39992f555c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.332719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce6b88-f685-4d3d-985a-6a39992f555c None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.333949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce6b88-f685-4d3d-985a-6a39992f555c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:10.334493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce6b88-f685-4d3d-985a-6a39992f555c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:10.334619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4259a-598a-4cd6-88b0-e8dfd3d51b4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:10.336004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4259a-598a-4cd6-88b0-e8dfd3d51b4b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:10.337094 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce6b88-f685-4d3d-985a-6a39992f555c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-eaf4259a-598a-4cd6-88b0-e8dfd3d51b4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:10.350721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:10.351716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:10.353238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 323/621] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jul 28 01:56:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:10.357964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4259a-598a-4cd6-88b0-e8dfd3d51b4b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:10.363171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 299/622] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jul 28 01:56:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:10.369338 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce6b88-f685-4d3d-985a-6a39992f555c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:10.481981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4259a-598a-4cd6-88b0-e8dfd3d51b4b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:10.502701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce6b88-f685-4d3d-985a-6a39992f555c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:10.518211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b2738-63aa-4e91-a0f7-246de253c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:10.518872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b2738-63aa-4e91-a0f7-246de253c315 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.519156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b2738-63aa-4e91-a0f7-246de253c315 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.519431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b2738-63aa-4e91-a0f7-246de253c315 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.520233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b2738-63aa-4e91-a0f7-246de253c315 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:10.520539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b2738-63aa-4e91-a0f7-246de253c315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:10.522155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b2738-63aa-4e91-a0f7-246de253c315 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:10.546887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 324/623] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jul 28 01:56:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:10.548186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf953bb-a061-47bf-a9de-2b4ae9b6a055 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.548474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf953bb-a061-47bf-a9de-2b4ae9b6a055 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.548750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf953bb-a061-47bf-a9de-2b4ae9b6a055 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.549671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bca3d1-20c1-4488-a380-bb3b7a597b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:10.550602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bca3d1-20c1-4488-a380-bb3b7a597b7a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.551096 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bca3d1-20c1-4488-a380-bb3b7a597b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.551892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bca3d1-20c1-4488-a380-bb3b7a597b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.555854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 325/624] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:10.556747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf953bb-a061-47bf-a9de-2b4ae9b6a055 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:10.567173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bca3d1-20c1-4488-a380-bb3b7a597b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:10.569240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bca3d1-20c1-4488-a380-bb3b7a597b7a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c3bca3d1-20c1-4488-a380-bb3b7a597b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:10.587207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:10.588165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:10.589075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:10.589075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:10.589075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:10.589075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:10.597652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 300/625] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:10.603516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:10.604525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8fb3-9323-4839-8171-03907bbf018a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.605059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8fb3-9323-4839-8171-03907bbf018a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.605538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8fb3-9323-4839-8171-03907bbf018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.630085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4e9f8fb3-9323-4839-8171-03907bbf018a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:10.631797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4e9f8fb3-9323-4839-8171-03907bbf018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:10.671206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf953bb-a061-47bf-a9de-2b4ae9b6a055 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:10.675955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:10.718709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6671334-cfed-4d63-ad54-c6cd958fb9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:10.719489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6671334-cfed-4d63-ad54-c6cd958fb9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.719671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6671334-cfed-4d63-ad54-c6cd958fb9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.719868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 301/626] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:10.719969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6671334-cfed-4d63-ad54-c6cd958fb9e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.721014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f8fb3-9323-4839-8171-03907bbf018a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:10.816864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6671334-cfed-4d63-ad54-c6cd958fb9e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:10.818875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6671334-cfed-4d63-ad54-c6cd958fb9e6 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:10.856113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:10.861758 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f8fb3-9323-4839-8171-03907bbf018a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:10.903874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9512437-a2f5-4e9b-9381-38846a0f5451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:10.904500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9512437-a2f5-4e9b-9381-38846a0f5451 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.905180 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9512437-a2f5-4e9b-9381-38846a0f5451 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.905460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9512437-a2f5-4e9b-9381-38846a0f5451 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.906158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9512437-a2f5-4e9b-9381-38846a0f5451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:10.906925 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9512437-a2f5-4e9b-9381-38846a0f5451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:10.908634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9512437-a2f5-4e9b-9381-38846a0f5451 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:10.922206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 302/627] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:10.922869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9512437-a2f5-4e9b-9381-38846a0f5451 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:10.937019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 326/628] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:10.938277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aed602-ae4f-4a83-8922-25749a8ccae3 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:10.938612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aed602-ae4f-4a83-8922-25749a8ccae3 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:10.938890 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aed602-ae4f-4a83-8922-25749a8ccae3 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:10.942571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 327/629] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:10.942571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aed602-ae4f-4a83-8922-25749a8ccae3 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:10.965844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:11.050793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9512437-a2f5-4e9b-9381-38846a0f5451 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.058457 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aed602-ae4f-4a83-8922-25749a8ccae3 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.085081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9e673-6025-454f-9e7c-1c98b1854e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:11.085653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9e673-6025-454f-9e7c-1c98b1854e7b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.085952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9e673-6025-454f-9e7c-1c98b1854e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.086215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9e673-6025-454f-9e7c-1c98b1854e7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.097113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2b729-8e2b-4396-a3c3-42dd237f3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:11.097252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9e673-6025-454f-9e7c-1c98b1854e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:11.097742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2b729-8e2b-4396-a3c3-42dd237f3456 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.098023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2b729-8e2b-4396-a3c3-42dd237f3456 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.098295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2b729-8e2b-4396-a3c3-42dd237f3456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.101378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b8c9e673-6025-454f-9e7c-1c98b1854e7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:11.102536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:11.103628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:11.104460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:11.106624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2b729-8e2b-4396-a3c3-42dd237f3456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:11.108657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 303/630] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:11.108884 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2b729-8e2b-4396-a3c3-42dd237f3456 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:11.109308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9e673-6025-454f-9e7c-1c98b1854e7b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-a0e2b729-8e2b-4396-a3c3-42dd237f3456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:11.121939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:11.123153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:11.124061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:11.124061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:11.124061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:11.124061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:11.124061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:11.124061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:11.124061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:11.124061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:11.124061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 328/631] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:11.124724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a01f4-6df5-4de2-911f-116a03fdfd60 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.124908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a01f4-6df5-4de2-911f-116a03fdfd60 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.125179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a01f4-6df5-4de2-911f-116a03fdfd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.143516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9d6a01f4-6df5-4de2-911f-116a03fdfd60 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:11.144706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9d6a01f4-6df5-4de2-911f-116a03fdfd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:11.214972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:11.224383 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9e673-6025-454f-9e7c-1c98b1854e7b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.234541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 329/632] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:11.234541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a01f4-6df5-4de2-911f-116a03fdfd60 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:11.261785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52e25-4bb4-43b3-9f5f-c923fc83a88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:11.262427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52e25-4bb4-43b3-9f5f-c923fc83a88a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.262732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52e25-4bb4-43b3-9f5f-c923fc83a88a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.263007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52e25-4bb4-43b3-9f5f-c923fc83a88a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.273302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae52e25-4bb4-43b3-9f5f-c923fc83a88a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:11.275317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae52e25-4bb4-43b3-9f5f-c923fc83a88a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5ae52e25-4bb4-43b3-9f5f-c923fc83a88a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:11.291586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:11.292545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:11.298341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:11.298341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:11.298341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:11.298341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:11.298341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 304/633] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:11.298341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52e25-4bb4-43b3-9f5f-c923fc83a88a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:11.357010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a01f4-6df5-4de2-911f-116a03fdfd60 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.383804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:11.393260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41a21f-cb1d-4261-971d-dec21b4e18ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:11.393876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41a21f-cb1d-4261-971d-dec21b4e18ff None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.394154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41a21f-cb1d-4261-971d-dec21b4e18ff None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.394425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41a21f-cb1d-4261-971d-dec21b4e18ff None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.395176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41a21f-cb1d-4261-971d-dec21b4e18ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:11.395479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41a21f-cb1d-4261-971d-dec21b4e18ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:11.396866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41a21f-cb1d-4261-971d-dec21b4e18ff None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:11.405697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52e25-4bb4-43b3-9f5f-c923fc83a88a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.410653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 330/634] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:11.411407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41a21f-cb1d-4261-971d-dec21b4e18ff None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:11.441594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4148-07a2-46b1-a9c5-b4026b20a9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:11.442391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4148-07a2-46b1-a9c5-b4026b20a9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.442759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4148-07a2-46b1-a9c5-b4026b20a9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.443084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4148-07a2-46b1-a9c5-b4026b20a9a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.443897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e4148-07a2-46b1-a9c5-b4026b20a9a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:11.444289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e4148-07a2-46b1-a9c5-b4026b20a9a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:11.445807 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e4148-07a2-46b1-a9c5-b4026b20a9a1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:11.463486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 305/635] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:11.463486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4148-07a2-46b1-a9c5-b4026b20a9a1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:11.465989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:11.525261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41a21f-cb1d-4261-971d-dec21b4e18ff None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.559662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d03d32-3dbe-4560-a4c0-0173b208952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:11.560291 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03d32-3dbe-4560-a4c0-0173b208952e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.560565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03d32-3dbe-4560-a4c0-0173b208952e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.560836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03d32-3dbe-4560-a4c0-0173b208952e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.567891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4148-07a2-46b1-a9c5-b4026b20a9a1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.571937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d03d32-3dbe-4560-a4c0-0173b208952e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-18d03d32-3dbe-4560-a4c0-0173b208952e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:11.577237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:11.578174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 331/636] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:11.579346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d03d32-3dbe-4560-a4c0-0173b208952e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:11.615069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144b5ed-1aba-416d-8261-4aa9891a6695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:11.616849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144b5ed-1aba-416d-8261-4aa9891a6695 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.617156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144b5ed-1aba-416d-8261-4aa9891a6695 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.617434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144b5ed-1aba-416d-8261-4aa9891a6695 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.618186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144b5ed-1aba-416d-8261-4aa9891a6695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:11.618631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144b5ed-1aba-416d-8261-4aa9891a6695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:11.620041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144b5ed-1aba-416d-8261-4aa9891a6695 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:11.630089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:11.636577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 306/637] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:11.636577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144b5ed-1aba-416d-8261-4aa9891a6695 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:11.694014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d03d32-3dbe-4560-a4c0-0173b208952e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.698298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:11.733640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb87472-a5d6-4e16-9aed-16b1d4c3fd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:11.734278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb87472-a5d6-4e16-9aed-16b1d4c3fd71 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.734830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb87472-a5d6-4e16-9aed-16b1d4c3fd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.734830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb87472-a5d6-4e16-9aed-16b1d4c3fd71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.737665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144b5ed-1aba-416d-8261-4aa9891a6695 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.745700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb87472-a5d6-4e16-9aed-16b1d4c3fd71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:11.747196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb87472-a5d6-4e16-9aed-16b1d4c3fd71 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-2cb87472-a5d6-4e16-9aed-16b1d4c3fd71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:11.761818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:11.762758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:11.763726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:11.763726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:11.763726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:11.763726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:11.763726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 332/638] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:11.764008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb87472-a5d6-4e16-9aed-16b1d4c3fd71 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:11.778612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc73de-fcc1-44f8-a01b-4ae1d5826477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:11.779290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc73de-fcc1-44f8-a01b-4ae1d5826477 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.779574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc73de-fcc1-44f8-a01b-4ae1d5826477 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.779852 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc73de-fcc1-44f8-a01b-4ae1d5826477 None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/a891bb14f40d403b90915115bc487b03/roles/d8f52393c9554176af3cc338302d1302` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.796920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc73de-fcc1-44f8-a01b-4ae1d5826477 None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=a891bb14f40d403b90915115bc487b03, role_id=d8f52393c9554176af3cc338302d1302)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:11.798729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc73de-fcc1-44f8-a01b-4ae1d5826477 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:11.822468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 307/639] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:56:11 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/a891bb14f40d403b90915115bc487b03/roles/d8f52393c9554176af3cc338302d1302 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:56:11.822468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc73de-fcc1-44f8-a01b-4ae1d5826477 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:11.891557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:11.895395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb87472-a5d6-4e16-9aed-16b1d4c3fd71 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.945335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ddff6-f854-4c0e-851c-3dbfc7df0ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:11.946466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ddff6-f854-4c0e-851c-3dbfc7df0ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:11.946814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ddff6-f854-4c0e-851c-3dbfc7df0ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:11.947095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ddff6-f854-4c0e-851c-3dbfc7df0ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:11.948115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ddff6-f854-4c0e-851c-3dbfc7df0ea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:11.948427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ddff6-f854-4c0e-851c-3dbfc7df0ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:11.950409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ddff6-f854-4c0e-851c-3dbfc7df0ea4 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:11.964963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 333/640] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:11.965958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ddff6-f854-4c0e-851c-3dbfc7df0ea4 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:11.966539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc73de-fcc1-44f8-a01b-4ae1d5826477 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:11.990530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:12.019179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53768c-3889-43b8-af3c-544bc75b710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:12.019642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53768c-3889-43b8-af3c-544bc75b710b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.019924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53768c-3889-43b8-af3c-544bc75b710b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.020194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53768c-3889-43b8-af3c-544bc75b710b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.028696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53768c-3889-43b8-af3c-544bc75b710b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:12.030192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53768c-3889-43b8-af3c-544bc75b710b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ed53768c-3889-43b8-af3c-544bc75b710b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:12.042913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:12.043973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:12.044869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:12.044869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:12.044869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:12.044869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:12.044869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:12.044869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:12.044869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:12.044869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:12.044869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 308/641] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:12.045838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53768c-3889-43b8-af3c-544bc75b710b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:12.110216 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ddff6-f854-4c0e-851c-3dbfc7df0ea4 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:12.154546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d42b5-db62-4778-b42a-4e4f270b95e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:12.155343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d42b5-db62-4778-b42a-4e4f270b95e9 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.155617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d42b5-db62-4778-b42a-4e4f270b95e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.156371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d42b5-db62-4778-b42a-4e4f270b95e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.157215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d42b5-db62-4778-b42a-4e4f270b95e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:12.157640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d42b5-db62-4778-b42a-4e4f270b95e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:12.159304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d42b5-db62-4778-b42a-4e4f270b95e9 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:12.175269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53768c-3889-43b8-af3c-544bc75b710b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:12.175546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 334/642] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:12.176402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d42b5-db62-4778-b42a-4e4f270b95e9 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:12.211475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:12.215450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e91bc-c929-4f1c-8eea-e7fc6f0082d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:12.216318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e91bc-c929-4f1c-8eea-e7fc6f0082d8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.216817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e91bc-c929-4f1c-8eea-e7fc6f0082d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.217174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e91bc-c929-4f1c-8eea-e7fc6f0082d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.229488 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e91bc-c929-4f1c-8eea-e7fc6f0082d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:12.231322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e91bc-c929-4f1c-8eea-e7fc6f0082d8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-de5e91bc-c929-4f1c-8eea-e7fc6f0082d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:12.248523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:12.249461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:12.250649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:12.250649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:12.250649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:12.250649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:12.250649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 309/643] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:12.251711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e91bc-c929-4f1c-8eea-e7fc6f0082d8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:12.284082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:12.299543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d42b5-db62-4778-b42a-4e4f270b95e9 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:12.337498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df326b-ec3f-497d-9b09-88d9b8a3cdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:12.338111 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df326b-ec3f-497d-9b09-88d9b8a3cdda None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.338472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df326b-ec3f-497d-9b09-88d9b8a3cdda None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.338854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df326b-ec3f-497d-9b09-88d9b8a3cdda None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.339722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df326b-ec3f-497d-9b09-88d9b8a3cdda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:12.340025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df326b-ec3f-497d-9b09-88d9b8a3cdda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:12.341463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df326b-ec3f-497d-9b09-88d9b8a3cdda None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:12.358977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 335/644] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:12.358977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df326b-ec3f-497d-9b09-88d9b8a3cdda None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:12.363356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e91bc-c929-4f1c-8eea-e7fc6f0082d8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:12.397299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd25cb5-c6f0-4cec-99ac-801fb033d4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:12.397933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25cb5-c6f0-4cec-99ac-801fb033d4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.398205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25cb5-c6f0-4cec-99ac-801fb033d4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.398493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25cb5-c6f0-4cec-99ac-801fb033d4b3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.406169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd25cb5-c6f0-4cec-99ac-801fb033d4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:12.407594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd25cb5-c6f0-4cec-99ac-801fb033d4b3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3dd25cb5-c6f0-4cec-99ac-801fb033d4b3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:12.419117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:12.420049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:12.420985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 310/645] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:12.421595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf3f8-2457-4636-9861-42c32cf58cd1 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.421663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf3f8-2457-4636-9861-42c32cf58cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.422234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf3f8-2457-4636-9861-42c32cf58cd1 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.423316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 311/646] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:12.423843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdf3f8-2457-4636-9861-42c32cf58cd1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:12.452362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:12.473740 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df326b-ec3f-497d-9b09-88d9b8a3cdda None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:12.517695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:12.519777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9962ea-1926-42fc-bdf8-cad89e6d35ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:12.520578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9962ea-1926-42fc-bdf8-cad89e6d35ce None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.520866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9962ea-1926-42fc-bdf8-cad89e6d35ce None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.521140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9962ea-1926-42fc-bdf8-cad89e6d35ce None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.521846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9962ea-1926-42fc-bdf8-cad89e6d35ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:12.522609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9962ea-1926-42fc-bdf8-cad89e6d35ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:12.523989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9962ea-1926-42fc-bdf8-cad89e6d35ce None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:12.535909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 336/647] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:12.536713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9962ea-1926-42fc-bdf8-cad89e6d35ce None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:12.537775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdf3f8-2457-4636-9861-42c32cf58cd1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:12.575550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac0ec-4443-4ec3-98b3-4c24ea099eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:12.576160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac0ec-4443-4ec3-98b3-4c24ea099eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.576435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac0ec-4443-4ec3-98b3-4c24ea099eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.576704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac0ec-4443-4ec3-98b3-4c24ea099eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.577479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac0ec-4443-4ec3-98b3-4c24ea099eb5 None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=b9f911e716994f1f9d4705216ee0f3a5) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:12.577782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac0ec-4443-4ec3-98b3-4c24ea099eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:12.579227 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac0ec-4443-4ec3-98b3-4c24ea099eb5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:12.585286 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 312/648] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:12 2022] GET /identity/v3/role_assignments?user.id=b9f911e716994f1f9d4705216ee0f3a5&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:12.586261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600214b-7888-4582-9079-24664178e5c0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.587136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600214b-7888-4582-9079-24664178e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.587411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600214b-7888-4582-9079-24664178e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.613326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7600214b-7888-4582-9079-24664178e5c0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:12.614724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7600214b-7888-4582-9079-24664178e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:12.664302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9962ea-1926-42fc-bdf8-cad89e6d35ce None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:12.709903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 313/649] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:12.709903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600214b-7888-4582-9079-24664178e5c0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:12.711086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387d028-3617-42ed-bcf8-5f9cfa287de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:12.711312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387d028-3617-42ed-bcf8-5f9cfa287de8 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.715035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387d028-3617-42ed-bcf8-5f9cfa287de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.715035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387d028-3617-42ed-bcf8-5f9cfa287de8 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.715035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387d028-3617-42ed-bcf8-5f9cfa287de8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:12.715035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387d028-3617-42ed-bcf8-5f9cfa287de8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:12.716440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387d028-3617-42ed-bcf8-5f9cfa287de8 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:12.743335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:12.748612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 337/650] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jul 28 01:56:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:12.749677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387d028-3617-42ed-bcf8-5f9cfa287de8 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:12.825446 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:12.857094 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600214b-7888-4582-9079-24664178e5c0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:12.883741 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387d028-3617-42ed-bcf8-5f9cfa287de8 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:12.914549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46dadc-069a-4539-952c-380245b95cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:12.914549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46dadc-069a-4539-952c-380245b95cdb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.914549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46dadc-069a-4539-952c-380245b95cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.914549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46dadc-069a-4539-952c-380245b95cdb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.926478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46dadc-069a-4539-952c-380245b95cdb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:12.926478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46dadc-069a-4539-952c-380245b95cdb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0f46dadc-069a-4539-952c-380245b95cdb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:12.940071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:12.941345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 314/651] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:12.942369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46dadc-069a-4539-952c-380245b95cdb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:12.954476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebb408-ac1e-4648-8a59-3831d152997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:12.954476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebb408-ac1e-4648-8a59-3831d152997c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:12.954476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebb408-ac1e-4648-8a59-3831d152997c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:12.954476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebb408-ac1e-4648-8a59-3831d152997c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:12.970462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebb408-ac1e-4648-8a59-3831d152997c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-82ebb408-ac1e-4648-8a59-3831d152997c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:12.978470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:12.980592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 338/652] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:12.981730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebb408-ac1e-4648-8a59-3831d152997c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:13.066473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:13.082479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46dadc-069a-4539-952c-380245b95cdb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:13.110870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebb408-ac1e-4648-8a59-3831d152997c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:13.144008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d5400-121c-4a9d-91a9-00755156f47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:13.144634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d5400-121c-4a9d-91a9-00755156f47d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:13.144909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d5400-121c-4a9d-91a9-00755156f47d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:13.145176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d5400-121c-4a9d-91a9-00755156f47d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:13.158328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:13.196872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612f93e-1d9e-4ab2-ac84-9887e3975b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:13.197417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f93e-1d9e-4ab2-ac84-9887e3975b66 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:13.197693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f93e-1d9e-4ab2-ac84-9887e3975b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:13.197963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f93e-1d9e-4ab2-ac84-9887e3975b66 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:13.198929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612f93e-1d9e-4ab2-ac84-9887e3975b66 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:13.199129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612f93e-1d9e-4ab2-ac84-9887e3975b66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:13.200539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612f93e-1d9e-4ab2-ac84-9887e3975b66 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:13.232997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d5400-121c-4a9d-91a9-00755156f47d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:13.234807 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d5400-121c-4a9d-91a9-00755156f47d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:13.252315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 339/653] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Jul 28 01:56:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:13.253008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612f93e-1d9e-4ab2-ac84-9887e3975b66 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:13.361006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 315/654] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:13.362234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d5400-121c-4a9d-91a9-00755156f47d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:13.422646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:13.474393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612f93e-1d9e-4ab2-ac84-9887e3975b66 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:13.506875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:13.513661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d5400-121c-4a9d-91a9-00755156f47d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:13.537187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d09a3-b445-4b98-b7ab-e6dcc3e4d403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:13.538679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d09a3-b445-4b98-b7ab-e6dcc3e4d403 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:13.539438 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d09a3-b445-4b98-b7ab-e6dcc3e4d403 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:13.539988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d09a3-b445-4b98-b7ab-e6dcc3e4d403 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:13.541539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d09a3-b445-4b98-b7ab-e6dcc3e4d403 None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:13.542364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d09a3-b445-4b98-b7ab-e6dcc3e4d403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:13.544621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d09a3-b445-4b98-b7ab-e6dcc3e4d403 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:13.552529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176a924-50fd-4013-ab86-0b4cca40ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:13.552808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176a924-50fd-4013-ab86-0b4cca40ef11 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:13.553092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176a924-50fd-4013-ab86-0b4cca40ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:13.553368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176a924-50fd-4013-ab86-0b4cca40ef11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:13.562652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 340/655] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:13.566671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d09a3-b445-4b98-b7ab-e6dcc3e4d403 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:13.647325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176a924-50fd-4013-ab86-0b4cca40ef11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:13.651059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176a924-50fd-4013-ab86-0b4cca40ef11 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:13.686175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d09a3-b445-4b98-b7ab-e6dcc3e4d403 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:13.703847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:13.729825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304003-d365-4bae-bd4c-75ec33a92b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:13.730833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304003-d365-4bae-bd4c-75ec33a92b9a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:13.731330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304003-d365-4bae-bd4c-75ec33a92b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:13.731820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304003-d365-4bae-bd4c-75ec33a92b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:13.744116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e304003-d365-4bae-bd4c-75ec33a92b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:13.746056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e304003-d365-4bae-bd4c-75ec33a92b9a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-8e304003-d365-4bae-bd4c-75ec33a92b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:13.762392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:13.763308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:13.764187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:13.764187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:13.764187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:13.764187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:13.770211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 316/656] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:13.770211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176a924-50fd-4013-ab86-0b4cca40ef11 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:13.771226 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 341/657] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:13.772294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304003-d365-4bae-bd4c-75ec33a92b9a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:13.806849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:13.887724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304003-d365-4bae-bd4c-75ec33a92b9a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:13.888997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176a924-50fd-4013-ab86-0b4cca40ef11 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:13.924677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a58193-ac9c-4543-a9ec-db0e2d282598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:13.925320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a58193-ac9c-4543-a9ec-db0e2d282598 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:13.925600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a58193-ac9c-4543-a9ec-db0e2d282598 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:13.925894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a58193-ac9c-4543-a9ec-db0e2d282598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:13.926985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9204b8-10e0-4d6c-8bd1-fed81cab64e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:13.927952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9204b8-10e0-4d6c-8bd1-fed81cab64e2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:13.928545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9204b8-10e0-4d6c-8bd1-fed81cab64e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:13.929015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9204b8-10e0-4d6c-8bd1-fed81cab64e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:13.934544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:13.936844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a58193-ac9c-4543-a9ec-db0e2d282598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:13.938297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a58193-ac9c-4543-a9ec-db0e2d282598 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:13.942572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9204b8-10e0-4d6c-8bd1-fed81cab64e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:13.944522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9204b8-10e0-4d6c-8bd1-fed81cab64e2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-27a58193-ac9c-4543-a9ec-db0e2d282598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:13.954514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:13.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:13.956280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:13.956280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:13.956280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:13.956280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:13.960265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 317/658] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:13.961108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a58193-ac9c-4543-a9ec-db0e2d282598 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-9f9204b8-10e0-4d6c-8bd1-fed81cab64e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:13.963405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:13.964558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:13.965434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:13.965434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:13.965434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:13.965434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:13.967543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 342/659] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:13.968534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9204b8-10e0-4d6c-8bd1-fed81cab64e2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.057443 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:14.066475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a58193-ac9c-4543-a9ec-db0e2d282598 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.074575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9204b8-10e0-4d6c-8bd1-fed81cab64e2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.103664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccc585-e2a5-4e5f-b1f3-ec0b618bc9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.104284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccc585-e2a5-4e5f-b1f3-ec0b618bc9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.104565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccc585-e2a5-4e5f-b1f3-ec0b618bc9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.104990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccc585-e2a5-4e5f-b1f3-ec0b618bc9d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.105567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccc585-e2a5-4e5f-b1f3-ec0b618bc9d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:14.105829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccc585-e2a5-4e5f-b1f3-ec0b618bc9d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:14.107233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccc585-e2a5-4e5f-b1f3-ec0b618bc9d5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:14.109769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9c89-6c5f-4ea9-8f19-4acc9fa1121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.110373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9c89-6c5f-4ea9-8f19-4acc9fa1121a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.110698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9c89-6c5f-4ea9-8f19-4acc9fa1121a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.110972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9c89-6c5f-4ea9-8f19-4acc9fa1121a None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.111658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff9c89-6c5f-4ea9-8f19-4acc9fa1121a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:14.111962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff9c89-6c5f-4ea9-8f19-4acc9fa1121a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:14.113319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff9c89-6c5f-4ea9-8f19-4acc9fa1121a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:14.120109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 318/660] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:14.120715 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccc585-e2a5-4e5f-b1f3-ec0b618bc9d5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.132627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 343/661] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:14.133923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bff13-8d3b-46e7-bde7-5e6c92bbca2b None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.134206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bff13-8d3b-46e7-bde7-5e6c92bbca2b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.134502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bff13-8d3b-46e7-bde7-5e6c92bbca2b None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.137841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 344/662] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:14.137841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bff13-8d3b-46e7-bde7-5e6c92bbca2b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.180161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:14.234384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccc585-e2a5-4e5f-b1f3-ec0b618bc9d5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.254288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bff13-8d3b-46e7-bde7-5e6c92bbca2b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.271435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf2caa-aed4-461d-978f-748876646a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.272059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf2caa-aed4-461d-978f-748876646a48 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.272340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf2caa-aed4-461d-978f-748876646a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.272610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf2caa-aed4-461d-978f-748876646a48 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.273302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf2caa-aed4-461d-978f-748876646a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:14.273607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf2caa-aed4-461d-978f-748876646a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:14.275554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf2caa-aed4-461d-978f-748876646a48 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:14.291250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 319/663] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:14.291250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf2caa-aed4-461d-978f-748876646a48 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.295315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d4470-bde6-4594-9ad9-ca35a30ce0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.295315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4470-bde6-4594-9ad9-ca35a30ce0de None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.295531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4470-bde6-4594-9ad9-ca35a30ce0de None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.295755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4470-bde6-4594-9ad9-ca35a30ce0de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.302908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d4470-bde6-4594-9ad9-ca35a30ce0de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:14.304566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d4470-bde6-4594-9ad9-ca35a30ce0de None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-776d4470-bde6-4594-9ad9-ca35a30ce0de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:14.316682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:14.317659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:14.318958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:14.318958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:14.318958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:14.318958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:14.318958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:14.318958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:14.318958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:14.318958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:14.318958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 345/664] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:14.319770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7762b4-9091-4c37-a417-34457882f14d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.320070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7762b4-9091-4c37-a417-34457882f14d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.320376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7762b4-9091-4c37-a417-34457882f14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.328414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:14.339625 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-8f7762b4-9091-4c37-a417-34457882f14d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:14.340827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8f7762b4-9091-4c37-a417-34457882f14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:14.405362 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf2caa-aed4-461d-978f-748876646a48 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.413769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 346/665] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:14.414684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7762b4-9091-4c37-a417-34457882f14d None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.427335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:14.452521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b2a26-867c-4afb-a99b-b5c15bd98e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.453616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b2a26-867c-4afb-a99b-b5c15bd98e00 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.454118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b2a26-867c-4afb-a99b-b5c15bd98e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.454656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b2a26-867c-4afb-a99b-b5c15bd98e00 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.463559 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b2a26-867c-4afb-a99b-b5c15bd98e00 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:14.465259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b2a26-867c-4afb-a99b-b5c15bd98e00 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-626b2a26-867c-4afb-a99b-b5c15bd98e00 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:14.477894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:14.478900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:14.479863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:14.479863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:14.479863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:14.479863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:14.479863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:14.479863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:14.479863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:14.479863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:14.479863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 01:56:14.479863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:14.485514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 320/666] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:14.485514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b2a26-867c-4afb-a99b-b5c15bd98e00 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.535162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7762b4-9091-4c37-a417-34457882f14d None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.573219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb70f-0937-4c2d-8bf8-38d5800b788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.574185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb70f-0937-4c2d-8bf8-38d5800b788e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.574640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb70f-0937-4c2d-8bf8-38d5800b788e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.575134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb70f-0937-4c2d-8bf8-38d5800b788e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.577152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:14.583274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58eb70f-0937-4c2d-8bf8-38d5800b788e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:14.585411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58eb70f-0937-4c2d-8bf8-38d5800b788e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:14.590382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b2a26-867c-4afb-a99b-b5c15bd98e00 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-c58eb70f-0937-4c2d-8bf8-38d5800b788e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:14.597527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:14.598636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:14.599819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:14.599819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:14.599819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:14.599819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:14.599819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:14.599819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:14.599819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:14.599819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:14.603970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 347/667] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:14.604910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb70f-0937-4c2d-8bf8-38d5800b788e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.627939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152cec0-fdfd-408a-85b1-0258de920723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.628555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152cec0-fdfd-408a-85b1-0258de920723 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.628836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152cec0-fdfd-408a-85b1-0258de920723 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.629106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152cec0-fdfd-408a-85b1-0258de920723 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.629849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152cec0-fdfd-408a-85b1-0258de920723 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:14.630162 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152cec0-fdfd-408a-85b1-0258de920723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:14.631628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152cec0-fdfd-408a-85b1-0258de920723 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:14.645916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 321/668] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:14.646972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152cec0-fdfd-408a-85b1-0258de920723 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.685630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:14.712605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb70f-0937-4c2d-8bf8-38d5800b788e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.748312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df08f7-43ee-40c6-8487-aadcac8ae1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.748951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df08f7-43ee-40c6-8487-aadcac8ae1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.749238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df08f7-43ee-40c6-8487-aadcac8ae1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.749515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df08f7-43ee-40c6-8487-aadcac8ae1a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.760303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df08f7-43ee-40c6-8487-aadcac8ae1a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:14.764064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152cec0-fdfd-408a-85b1-0258de920723 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-50df08f7-43ee-40c6-8487-aadcac8ae1a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:14.765624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:14.766746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:14.767658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 348/669] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:14.768357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df08f7-43ee-40c6-8487-aadcac8ae1a9 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.801661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264359b-309a-4339-8dfb-71222a79559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.802281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264359b-309a-4339-8dfb-71222a79559a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.802592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264359b-309a-4339-8dfb-71222a79559a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.802864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264359b-309a-4339-8dfb-71222a79559a None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.803652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264359b-309a-4339-8dfb-71222a79559a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:14.803957 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264359b-309a-4339-8dfb-71222a79559a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:14.805411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264359b-309a-4339-8dfb-71222a79559a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:14.822874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 322/670] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:14.823692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:14.823809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264359b-309a-4339-8dfb-71222a79559a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.871556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df08f7-43ee-40c6-8487-aadcac8ae1a9 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.907414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935abf3-38b7-464d-839f-1f1c9abec4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.908027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935abf3-38b7-464d-839f-1f1c9abec4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.908305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935abf3-38b7-464d-839f-1f1c9abec4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.908576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935abf3-38b7-464d-839f-1f1c9abec4b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.909327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935abf3-38b7-464d-839f-1f1c9abec4b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:14.909630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935abf3-38b7-464d-839f-1f1c9abec4b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:14.911092 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935abf3-38b7-464d-839f-1f1c9abec4b6 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:14.912269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:14.922406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264359b-309a-4339-8dfb-71222a79559a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:14.923578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 349/671] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:14.924817 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8929d6-ebd1-4189-af59-499cf22284cb None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.925158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8929d6-ebd1-4189-af59-499cf22284cb None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.925436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8929d6-ebd1-4189-af59-499cf22284cb None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.926664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 350/672] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:14.927350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8929d6-ebd1-4189-af59-499cf22284cb None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:14.961384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9929e-a610-4cf7-a301-3d174e45384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:14.962603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9929e-a610-4cf7-a301-3d174e45384b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:14.962876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9929e-a610-4cf7-a301-3d174e45384b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:14.963164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9929e-a610-4cf7-a301-3d174e45384b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:14.963943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9929e-a610-4cf7-a301-3d174e45384b None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=ece4e0b16a9441b5ba14bbc8ff1c632c) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:14.964250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9929e-a610-4cf7-a301-3d174e45384b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:14.965676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9929e-a610-4cf7-a301-3d174e45384b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:14.971729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 323/673] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/role_assignments?user.id=ece4e0b16a9441b5ba14bbc8ff1c632c&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:14.972576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9929e-a610-4cf7-a301-3d174e45384b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:15.037119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8929d6-ebd1-4189-af59-499cf22284cb None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:15.054615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:15.077354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892af02-1035-48f6-be7f-5c8d976d235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:15.077894 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892af02-1035-48f6-be7f-5c8d976d235e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:15.078177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892af02-1035-48f6-be7f-5c8d976d235e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:15.078473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892af02-1035-48f6-be7f-5c8d976d235e None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:15.079208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892af02-1035-48f6-be7f-5c8d976d235e None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:15.079508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892af02-1035-48f6-be7f-5c8d976d235e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:15.080909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892af02-1035-48f6-be7f-5c8d976d235e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:15.090413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 351/674] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:15.091186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9929e-a610-4cf7-a301-3d174e45384b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:15.091298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892af02-1035-48f6-be7f-5c8d976d235e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:15.135797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147f213-1bdf-4ddd-80eb-c3a9d1db38c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:15.136424 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147f213-1bdf-4ddd-80eb-c3a9d1db38c4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:15.136706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147f213-1bdf-4ddd-80eb-c3a9d1db38c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:15.137434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147f213-1bdf-4ddd-80eb-c3a9d1db38c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:15.166008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:15.217186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147f213-1bdf-4ddd-80eb-c3a9d1db38c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:15.218727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147f213-1bdf-4ddd-80eb-c3a9d1db38c4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:15.219931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892af02-1035-48f6-be7f-5c8d976d235e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:15.254490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5922223-1856-4716-9204-4a5b7f191324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:15.255099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5922223-1856-4716-9204-4a5b7f191324 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:15.255374 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5922223-1856-4716-9204-4a5b7f191324 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:15.255642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5922223-1856-4716-9204-4a5b7f191324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:15.256420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5922223-1856-4716-9204-4a5b7f191324 None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=983bd6880830419f9158b33411b57f04) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:15.256723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5922223-1856-4716-9204-4a5b7f191324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:15.258137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5922223-1856-4716-9204-4a5b7f191324 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:15.272421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 352/675] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:15 2022] GET /identity/v3/role_assignments?user.id=983bd6880830419f9158b33411b57f04&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:15.272421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bc479-6346-4de6-9205-bf0d4a435c8f None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:15.272421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bc479-6346-4de6-9205-bf0d4a435c8f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:15.272421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bc479-6346-4de6-9205-bf0d4a435c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:15.285916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-749bc479-6346-4de6-9205-bf0d4a435c8f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:15.287297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-749bc479-6346-4de6-9205-bf0d4a435c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:15.325150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:15.342252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 324/676] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:15.343251 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147f213-1bdf-4ddd-80eb-c3a9d1db38c4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:15.374824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 353/677] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:15.376045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bc479-6346-4de6-9205-bf0d4a435c8f None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:15.426760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:15.482604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147f213-1bdf-4ddd-80eb-c3a9d1db38c4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:15.511406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bc479-6346-4de6-9205-bf0d4a435c8f None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:15.519934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c95ac-386d-4add-b7b7-cf15b91bb090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:15.520589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c95ac-386d-4add-b7b7-cf15b91bb090 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:15.520874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c95ac-386d-4add-b7b7-cf15b91bb090 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:15.521517 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c95ac-386d-4add-b7b7-cf15b91bb090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:15.533393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c95ac-386d-4add-b7b7-cf15b91bb090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:15.536701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c95ac-386d-4add-b7b7-cf15b91bb090 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-196c95ac-386d-4add-b7b7-cf15b91bb090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:15.550161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:15.551119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:15.551995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:15.551995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:15.551995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:15.551995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:15.551995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 325/678] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:15.552768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c95ac-386d-4add-b7b7-cf15b91bb090 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:15.553840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d484ef7-29ac-4229-bfd9-e18fe49f5591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:15.554431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d484ef7-29ac-4229-bfd9-e18fe49f5591 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:15.554827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d484ef7-29ac-4229-bfd9-e18fe49f5591 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:15.555134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d484ef7-29ac-4229-bfd9-e18fe49f5591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:15.567010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d484ef7-29ac-4229-bfd9-e18fe49f5591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:15.568931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d484ef7-29ac-4229-bfd9-e18fe49f5591 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-4d484ef7-29ac-4229-bfd9-e18fe49f5591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:15.586152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:15.587746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:15.588636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:15.588636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:15.588636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:15.588636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:15.588636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 354/679] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:15.589340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d484ef7-29ac-4229-bfd9-e18fe49f5591 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:15.616881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:15.657529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c95ac-386d-4add-b7b7-cf15b91bb090 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:15.665285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:15.694471 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b4393-2c3a-469d-920b-c5eee8a91af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:15.695120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b4393-2c3a-469d-920b-c5eee8a91af1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:15.695401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b4393-2c3a-469d-920b-c5eee8a91af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:15.695672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b4393-2c3a-469d-920b-c5eee8a91af1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:15.700781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d484ef7-29ac-4229-bfd9-e18fe49f5591 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:15.706783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b4393-2c3a-469d-920b-c5eee8a91af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0b0b4393-2c3a-469d-920b-c5eee8a91af1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:15.712705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:15.714821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 326/680] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:15.716772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b4393-2c3a-469d-920b-c5eee8a91af1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:15.737871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad607f4-9b66-46bf-8e17-41cceae396e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:15.738529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad607f4-9b66-46bf-8e17-41cceae396e9 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:15.738814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad607f4-9b66-46bf-8e17-41cceae396e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:15.739131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad607f4-9b66-46bf-8e17-41cceae396e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:15.739938 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad607f4-9b66-46bf-8e17-41cceae396e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:15.740247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad607f4-9b66-46bf-8e17-41cceae396e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:15.741783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad607f4-9b66-46bf-8e17-41cceae396e9 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:15.755686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 355/681] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:15.756633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad607f4-9b66-46bf-8e17-41cceae396e9 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:15.823456 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b4393-2c3a-469d-920b-c5eee8a91af1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:15.846891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:15.865046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72871940-3920-4db0-ad54-f1fd6cecbd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:15.865697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72871940-3920-4db0-ad54-f1fd6cecbd0c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:15.865977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72871940-3920-4db0-ad54-f1fd6cecbd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:15.866250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72871940-3920-4db0-ad54-f1fd6cecbd0c None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:15.867144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72871940-3920-4db0-ad54-f1fd6cecbd0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:15.867312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72871940-3920-4db0-ad54-f1fd6cecbd0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:15.868804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad607f4-9b66-46bf-8e17-41cceae396e9 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:15.869940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72871940-3920-4db0-ad54-f1fd6cecbd0c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:15.886158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 327/682] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:15.887048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72871940-3920-4db0-ad54-f1fd6cecbd0c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:15.913384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cfbc6-ba5e-4b9e-9ada-ab918590b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:15.914462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cfbc6-ba5e-4b9e-9ada-ab918590b3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:15.915018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cfbc6-ba5e-4b9e-9ada-ab918590b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:15.915492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cfbc6-ba5e-4b9e-9ada-ab918590b3d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:15.916297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:15.916943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cfbc6-ba5e-4b9e-9ada-ab918590b3d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:15.918165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cfbc6-ba5e-4b9e-9ada-ab918590b3d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:15.919852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cfbc6-ba5e-4b9e-9ada-ab918590b3d0 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:15.929224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 356/683] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:15.930878 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cfbc6-ba5e-4b9e-9ada-ab918590b3d0 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:15.998348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72871940-3920-4db0-ad54-f1fd6cecbd0c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.035588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a8307-16be-474d-95c1-8379874e7a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:16.036235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a8307-16be-474d-95c1-8379874e7a73 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:16.036516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a8307-16be-474d-95c1-8379874e7a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:16.036784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a8307-16be-474d-95c1-8379874e7a73 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:16.039267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cfbc6-ba5e-4b9e-9ada-ab918590b3d0 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.044563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a8307-16be-474d-95c1-8379874e7a73 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:16.046031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a8307-16be-474d-95c1-8379874e7a73 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d17a8307-16be-474d-95c1-8379874e7a73 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:16.059391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:16.060370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:16.061312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 328/684] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:16.061909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a8307-16be-474d-95c1-8379874e7a73 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:16.080199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da14a0-65f6-479d-ba1f-b982b3a58407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:16.081282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da14a0-65f6-479d-ba1f-b982b3a58407 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:16.081759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da14a0-65f6-479d-ba1f-b982b3a58407 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:16.082280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da14a0-65f6-479d-ba1f-b982b3a58407 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:16.089718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da14a0-65f6-479d-ba1f-b982b3a58407 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:16.091572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da14a0-65f6-479d-ba1f-b982b3a58407 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-25da14a0-65f6-479d-ba1f-b982b3a58407 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:16.104750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:16.105689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:16.107072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:16.107072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:16.107072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:16.107072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:16.107072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:16.107072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:16.107072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:16.107072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:16.109880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 357/685] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:16.111031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da14a0-65f6-479d-ba1f-b982b3a58407 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:16.115330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:16.159735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:16.177179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a8307-16be-474d-95c1-8379874e7a73 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.216697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261782-990c-4a2a-84c4-5506728f1d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:16.217695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261782-990c-4a2a-84c4-5506728f1d1b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:16.218224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261782-990c-4a2a-84c4-5506728f1d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:16.218878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261782-990c-4a2a-84c4-5506728f1d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:16.224647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da14a0-65f6-479d-ba1f-b982b3a58407 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.231241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63261782-990c-4a2a-84c4-5506728f1d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:16.232972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63261782-990c-4a2a-84c4-5506728f1d1b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-63261782-990c-4a2a-84c4-5506728f1d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:16.252065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:16.255878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:16.256796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:16.256796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:16.256796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:16.256796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:16.258934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 329/686] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:16.259893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261782-990c-4a2a-84c4-5506728f1d1b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:16.262115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc2f6b-3189-4579-892d-11466659506c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:16.263405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2f6b-3189-4579-892d-11466659506c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:16.263794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2f6b-3189-4579-892d-11466659506c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:16.264997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2f6b-3189-4579-892d-11466659506c None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:16.265157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc2f6b-3189-4579-892d-11466659506c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:16.265565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc2f6b-3189-4579-892d-11466659506c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:16.267132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc2f6b-3189-4579-892d-11466659506c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:16.285569 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 358/687] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jul 28 01:56:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:16.286525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc2f6b-3189-4579-892d-11466659506c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:16.351753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:16.373255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261782-990c-4a2a-84c4-5506728f1d1b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.394805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc2f6b-3189-4579-892d-11466659506c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.409976 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd873cb-75ab-4281-a742-c8d942e3d9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:16.411015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd873cb-75ab-4281-a742-c8d942e3d9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:16.411444 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd873cb-75ab-4281-a742-c8d942e3d9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:16.411869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd873cb-75ab-4281-a742-c8d942e3d9c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:16.412903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd873cb-75ab-4281-a742-c8d942e3d9c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:16.413427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd873cb-75ab-4281-a742-c8d942e3d9c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:16.416905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd873cb-75ab-4281-a742-c8d942e3d9c4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:16.427024 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:16.434153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 330/688] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:16.435050 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd873cb-75ab-4281-a742-c8d942e3d9c4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:16.438791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bc5f2-8a49-4089-9f39-6a789f2e41dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:16.439739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bc5f2-8a49-4089-9f39-6a789f2e41dd None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:16.440196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bc5f2-8a49-4089-9f39-6a789f2e41dd None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:16.440646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bc5f2-8a49-4089-9f39-6a789f2e41dd None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:16.441810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bc5f2-8a49-4089-9f39-6a789f2e41dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:16.442295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bc5f2-8a49-4089-9f39-6a789f2e41dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:16.443915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bc5f2-8a49-4089-9f39-6a789f2e41dd None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:16.456946 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 359/689] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:16.458047 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bc5f2-8a49-4089-9f39-6a789f2e41dd None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:16.546242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd873cb-75ab-4281-a742-c8d942e3d9c4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.568675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bc5f2-8a49-4089-9f39-6a789f2e41dd None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.585354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a747f-8555-4a26-9b71-133e07304e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:16.586045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a747f-8555-4a26-9b71-133e07304e01 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:16.586399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a747f-8555-4a26-9b71-133e07304e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:16.587325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a747f-8555-4a26-9b71-133e07304e01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:16.594895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:16.608825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d45e07-1500-4f03-ba1b-1775ff042aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:16.609865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d45e07-1500-4f03-ba1b-1775ff042aff None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:16.610328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d45e07-1500-4f03-ba1b-1775ff042aff None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:16.610804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d45e07-1500-4f03-ba1b-1775ff042aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:16.611809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d45e07-1500-4f03-ba1b-1775ff042aff None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=50bf5763fbf94aa9b438a1be6ce88c58) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:16.612301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d45e07-1500-4f03-ba1b-1775ff042aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:16.614050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d45e07-1500-4f03-ba1b-1775ff042aff None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:16.621406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 360/690] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:16 2022] GET /identity/v3/role_assignments?user.id=50bf5763fbf94aa9b438a1be6ce88c58&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:16.622651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d45e07-1500-4f03-ba1b-1775ff042aff None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:16.662499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:16.666430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a747f-8555-4a26-9b71-133e07304e01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:16.667947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a747f-8555-4a26-9b71-133e07304e01 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:16.736537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d45e07-1500-4f03-ba1b-1775ff042aff None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.772938 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f6f70-6f6e-4726-9d26-0f31eaaaf96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:16.774536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6f70-6f6e-4726-9d26-0f31eaaaf96a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:16.775026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6f70-6f6e-4726-9d26-0f31eaaaf96a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:16.775503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6f70-6f6e-4726-9d26-0f31eaaaf96a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:16.781218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 331/691] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:16.784433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f6f70-6f6e-4726-9d26-0f31eaaaf96a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:16.786219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f6f70-6f6e-4726-9d26-0f31eaaaf96a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:16.786743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a747f-8555-4a26-9b71-133e07304e01 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-004f6f70-6f6e-4726-9d26-0f31eaaaf96a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:16.800015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:16.801030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:16.802045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:16.802045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:16.802045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:16.802045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:16.802045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:16.802045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:16.802045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:16.802045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:16.802045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:16.802045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:16.804740 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 361/692] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jul 28 01:56:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:16.811487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f6f70-6f6e-4726-9d26-0f31eaaaf96a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:16.871634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:16.946379 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f6f70-6f6e-4726-9d26-0f31eaaaf96a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.954703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:16.959543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a747f-8555-4a26-9b71-133e07304e01 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:16.996929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284bf1-4f57-4bb2-99e4-357b87b189a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:16.997555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284bf1-4f57-4bb2-99e4-357b87b189a9 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:16.997835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284bf1-4f57-4bb2-99e4-357b87b189a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:16.998107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284bf1-4f57-4bb2-99e4-357b87b189a9 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.000838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284bf1-4f57-4bb2-99e4-357b87b189a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:17.001151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284bf1-4f57-4bb2-99e4-357b87b189a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:17.002702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284bf1-4f57-4bb2-99e4-357b87b189a9 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:17.007408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee5670-981e-48db-ab08-dbc050e1af5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:17.008060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee5670-981e-48db-ab08-dbc050e1af5c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.008880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee5670-981e-48db-ab08-dbc050e1af5c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.009155 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee5670-981e-48db-ab08-dbc050e1af5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.022846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee5670-981e-48db-ab08-dbc050e1af5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:17.024389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee5670-981e-48db-ab08-dbc050e1af5c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:17.029165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 362/693] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jul 28 01:56:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:17.037160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284bf1-4f57-4bb2-99e4-357b87b189a9 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-fcee5670-981e-48db-ab08-dbc050e1af5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:17.040726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:17.041578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:17.043252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:17.043252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:17.043252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:17.043252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:17.043252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 332/694] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:17.047392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee5670-981e-48db-ab08-dbc050e1af5c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:17.156430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee5670-981e-48db-ab08-dbc050e1af5c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:17.176729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284bf1-4f57-4bb2-99e4-357b87b189a9 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:17.182031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:17.193657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4f33b-8b46-418a-be9b-a809126ddafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:17.194284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4f33b-8b46-418a-be9b-a809126ddafd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.194606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4f33b-8b46-418a-be9b-a809126ddafd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.194878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4f33b-8b46-418a-be9b-a809126ddafd None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.195571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4f33b-8b46-418a-be9b-a809126ddafd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:17.195921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4f33b-8b46-418a-be9b-a809126ddafd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:17.197348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4f33b-8b46-418a-be9b-a809126ddafd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:17.212988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 333/695] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:17.214425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51aebb-47e3-41da-90f9-2106316150fc None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.214751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51aebb-47e3-41da-90f9-2106316150fc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.215031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51aebb-47e3-41da-90f9-2106316150fc None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.216510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 334/696] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:17.221451 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51aebb-47e3-41da-90f9-2106316150fc None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:17.229907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915185-8260-4539-bb6a-51a20a58a000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:17.231321 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915185-8260-4539-bb6a-51a20a58a000 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.231747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915185-8260-4539-bb6a-51a20a58a000 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.232160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915185-8260-4539-bb6a-51a20a58a000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.234427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:17.310981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915185-8260-4539-bb6a-51a20a58a000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:17.312858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915185-8260-4539-bb6a-51a20a58a000 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:17.338611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51aebb-47e3-41da-90f9-2106316150fc None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:17.375269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a9bef-adce-4abe-bfe6-d7565e8041bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:17.376182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a9bef-adce-4abe-bfe6-d7565e8041bb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.376636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a9bef-adce-4abe-bfe6-d7565e8041bb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.377045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a9bef-adce-4abe-bfe6-d7565e8041bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.384765 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a9bef-adce-4abe-bfe6-d7565e8041bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:17.386414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a9bef-adce-4abe-bfe6-d7565e8041bb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-aa8a9bef-adce-4abe-bfe6-d7565e8041bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:17.398554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:17.399790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:17.400901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:17.400901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:17.400901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:17.400901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:17.400901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:17.400901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:17.400901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:17.400901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:17.403126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 335/697] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:17.404668 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faa732-0cce-4e37-9312-bc2c159b401e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.405105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faa732-0cce-4e37-9312-bc2c159b401e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.405555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faa732-0cce-4e37-9312-bc2c159b401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.425602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-16faa732-0cce-4e37-9312-bc2c159b401e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:17.427159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-16faa732-0cce-4e37-9312-bc2c159b401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:17.503165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:17.508993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 336/698] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:17.510088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faa732-0cce-4e37-9312-bc2c159b401e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:17.548981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 363/699] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:17.550040 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915185-8260-4539-bb6a-51a20a58a000 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:17.553684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:17.616968 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faa732-0cce-4e37-9312-bc2c159b401e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:17.651541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6635-f715-4e2f-9891-ccc8f8b9c535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:17.652161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6635-f715-4e2f-9891-ccc8f8b9c535 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.652448 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6635-f715-4e2f-9891-ccc8f8b9c535 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.652725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6635-f715-4e2f-9891-ccc8f8b9c535 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.653477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6635-f715-4e2f-9891-ccc8f8b9c535 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:17.653788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6635-f715-4e2f-9891-ccc8f8b9c535 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:17.655278 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6635-f715-4e2f-9891-ccc8f8b9c535 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:17.659119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915185-8260-4539-bb6a-51a20a58a000 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:17.667151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 337/700] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:17.667952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6635-f715-4e2f-9891-ccc8f8b9c535 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:17.698515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bc6db-4a37-44af-8677-1099d118aacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:17.699441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc6db-4a37-44af-8677-1099d118aacb None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.699900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc6db-4a37-44af-8677-1099d118aacb None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.700406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc6db-4a37-44af-8677-1099d118aacb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.712057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bc6db-4a37-44af-8677-1099d118aacb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:17.713834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bc6db-4a37-44af-8677-1099d118aacb None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-f20bc6db-4a37-44af-8677-1099d118aacb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:17.728957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:17.729871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:17.730801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:17.730801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:17.730801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:17.730801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:17.731656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:17.733746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 364/701] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:17.735090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff105d-5dec-41f3-87d0-c4076c4fc274 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.735500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff105d-5dec-41f3-87d0-c4076c4fc274 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.735912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff105d-5dec-41f3-87d0-c4076c4fc274 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.741112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 365/702] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:17.741112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff105d-5dec-41f3-87d0-c4076c4fc274 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:17.779457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6635-f715-4e2f-9891-ccc8f8b9c535 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:17.797434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:17.819372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad779c6-2d52-43f2-a8ba-cd327da64ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:17.820017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad779c6-2d52-43f2-a8ba-cd327da64ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.820298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad779c6-2d52-43f2-a8ba-cd327da64ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.820571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad779c6-2d52-43f2-a8ba-cd327da64ab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.832138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad779c6-2d52-43f2-a8ba-cd327da64ab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:17.833579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad779c6-2d52-43f2-a8ba-cd327da64ab9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5ad779c6-2d52-43f2-a8ba-cd327da64ab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:17.847917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:17.848878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:17.849755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:17.849755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:17.849755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:17.849755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:17.849982 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff105d-5dec-41f3-87d0-c4076c4fc274 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:17.854102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 338/703] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:17.855087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad779c6-2d52-43f2-a8ba-cd327da64ab9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:17.899296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58b169-502f-43e0-8d5c-81e82f9e3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:17.899917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b169-502f-43e0-8d5c-81e82f9e3583 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.900254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b169-502f-43e0-8d5c-81e82f9e3583 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.901192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b169-502f-43e0-8d5c-81e82f9e3583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.901392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58b169-502f-43e0-8d5c-81e82f9e3583 None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=a891bb14f40d403b90915115bc487b03) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:17.901661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58b169-502f-43e0-8d5c-81e82f9e3583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:17.903134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58b169-502f-43e0-8d5c-81e82f9e3583 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:17.909287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 366/704] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:17 2022] GET /identity/v3/role_assignments?user.id=a891bb14f40d403b90915115bc487b03&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:17.910286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ebab-83fb-4f65-ad1c-de6e5b9b19b4 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:17.910632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ebab-83fb-4f65-ad1c-de6e5b9b19b4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:17.910911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ebab-83fb-4f65-ad1c-de6e5b9b19b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:17.931095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-0d81ebab-83fb-4f65-ad1c-de6e5b9b19b4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:17.932470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0d81ebab-83fb-4f65-ad1c-de6e5b9b19b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:18.001459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad779c6-2d52-43f2-a8ba-cd327da64ab9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:18.006747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 367/705] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:18.011684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ebab-83fb-4f65-ad1c-de6e5b9b19b4 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:18.018533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:18.046955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba4ba6-a4a0-41b7-8bce-c2ac1ce15c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:18.047942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4ba6-a4a0-41b7-8bce-c2ac1ce15c90 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:18.048443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4ba6-a4a0-41b7-8bce-c2ac1ce15c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:18.048915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4ba6-a4a0-41b7-8bce-c2ac1ce15c90 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:18.049840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba4ba6-a4a0-41b7-8bce-c2ac1ce15c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:18.050361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba4ba6-a4a0-41b7-8bce-c2ac1ce15c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:18.052014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba4ba6-a4a0-41b7-8bce-c2ac1ce15c90 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:18.067561 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 339/706] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:18.068752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba4ba6-a4a0-41b7-8bce-c2ac1ce15c90 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:18.086218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:18.155955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ebab-83fb-4f65-ad1c-de6e5b9b19b4 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:18.191850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba4ba6-a4a0-41b7-8bce-c2ac1ce15c90 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:18.196708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ce5f8-9241-4903-b160-82b734cc1b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:18.197969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ce5f8-9241-4903-b160-82b734cc1b7c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:18.198482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ce5f8-9241-4903-b160-82b734cc1b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:18.198960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ce5f8-9241-4903-b160-82b734cc1b7c None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:18.200425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ce5f8-9241-4903-b160-82b734cc1b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:18.200961 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ce5f8-9241-4903-b160-82b734cc1b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:18.204112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ce5f8-9241-4903-b160-82b734cc1b7c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:18.220124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 368/707] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:18.221235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ce5f8-9241-4903-b160-82b734cc1b7c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:18.239049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d28a0-5dd5-4e6a-a948-9ce1a191daf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:18.239882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d28a0-5dd5-4e6a-a948-9ce1a191daf3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:18.240268 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d28a0-5dd5-4e6a-a948-9ce1a191daf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:18.240555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d28a0-5dd5-4e6a-a948-9ce1a191daf3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:18.241177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d28a0-5dd5-4e6a-a948-9ce1a191daf3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:18.242777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d28a0-5dd5-4e6a-a948-9ce1a191daf3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b58d28a0-5dd5-4e6a-a948-9ce1a191daf3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:18.256254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:18.257237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:18.258100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 340/708] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Jul 28 01:56:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:18.259046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d28a0-5dd5-4e6a-a948-9ce1a191daf3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:18.305619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:18.364882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ce5f8-9241-4903-b160-82b734cc1b7c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:18.380014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:18.388647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d28a0-5dd5-4e6a-a948-9ce1a191daf3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:18.411545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e5baf-03fe-4839-b584-2ec1416a4349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:18.412701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e5baf-03fe-4839-b584-2ec1416a4349 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:18.413583 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e5baf-03fe-4839-b584-2ec1416a4349 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:18.414326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e5baf-03fe-4839-b584-2ec1416a4349 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:18.416023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e5baf-03fe-4839-b584-2ec1416a4349 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:18.418506 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e5baf-03fe-4839-b584-2ec1416a4349 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:18.424409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27612060-c85e-4287-bbdd-72150d3a81ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:18.425093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612060-c85e-4287-bbdd-72150d3a81ea None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:18.425369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612060-c85e-4287-bbdd-72150d3a81ea None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:18.425690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612060-c85e-4287-bbdd-72150d3a81ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:18.433811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27612060-c85e-4287-bbdd-72150d3a81ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:18.435437 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27612060-c85e-4287-bbdd-72150d3a81ea None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:18.447097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 369/709] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:56:18 2022] POST /identity/v3/users => generated 254 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:18.448328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e5baf-03fe-4839-b584-2ec1416a4349 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-27612060-c85e-4287-bbdd-72150d3a81ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:18.457163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:18.458154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:18.459069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:18.459069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:18.459069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:18.459069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:18.459069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:18.459069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:18.459069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:18.459069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:18.459069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 341/710] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:18.468657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27612060-c85e-4287-bbdd-72150d3a81ea None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:18.633920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e5baf-03fe-4839-b584-2ec1416a4349 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:18.657207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:18.664270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27612060-c85e-4287-bbdd-72150d3a81ea None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:18.676557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55182d17-861e-4f17-ae4c-6973b831933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:18.677578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182d17-861e-4f17-ae4c-6973b831933b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:18.678094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182d17-861e-4f17-ae4c-6973b831933b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:18.678678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182d17-861e-4f17-ae4c-6973b831933b None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:18.679791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55182d17-861e-4f17-ae4c-6973b831933b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:18.680978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55182d17-861e-4f17-ae4c-6973b831933b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:18.682633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55182d17-861e-4f17-ae4c-6973b831933b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:18.688124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 370/711] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jul 28 01:56:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:18.694763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55182d17-861e-4f17-ae4c-6973b831933b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:18.705825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f0876-c9e7-4e3e-9aa8-5236cfcda0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:18.706508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f0876-c9e7-4e3e-9aa8-5236cfcda0ad None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:18.706762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f0876-c9e7-4e3e-9aa8-5236cfcda0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:18.707031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f0876-c9e7-4e3e-9aa8-5236cfcda0ad None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:18.707929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f0876-c9e7-4e3e-9aa8-5236cfcda0ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:18.708235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f0876-c9e7-4e3e-9aa8-5236cfcda0ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:18.709740 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f0876-c9e7-4e3e-9aa8-5236cfcda0ad None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:18.728804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 342/712] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:18.732545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f0876-c9e7-4e3e-9aa8-5236cfcda0ad None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:18.736589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:18.837110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55182d17-861e-4f17-ae4c-6973b831933b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:18.856031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f0876-c9e7-4e3e-9aa8-5236cfcda0ad None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:18.889231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae646ef3-4feb-44a9-a527-5ce0f534f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:18.890103 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646ef3-4feb-44a9-a527-5ce0f534f467 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:18.890546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646ef3-4feb-44a9-a527-5ce0f534f467 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:18.890978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646ef3-4feb-44a9-a527-5ce0f534f467 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:18.891821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae646ef3-4feb-44a9-a527-5ce0f534f467 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:18.892266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae646ef3-4feb-44a9-a527-5ce0f534f467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:18.893994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae646ef3-4feb-44a9-a527-5ce0f534f467 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:18.901544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed1ba5-38c2-41ea-96a6-31e5dbc68805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:18.901544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1ba5-38c2-41ea-96a6-31e5dbc68805 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:18.901786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1ba5-38c2-41ea-96a6-31e5dbc68805 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:18.901995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1ba5-38c2-41ea-96a6-31e5dbc68805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:18.902389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 371/713] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jul 28 01:56:18 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:18.902816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed1ba5-38c2-41ea-96a6-31e5dbc68805 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=b9f911e716994f1f9d4705216ee0f3a5) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:18.903128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed1ba5-38c2-41ea-96a6-31e5dbc68805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:18.904814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed1ba5-38c2-41ea-96a6-31e5dbc68805 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:18.917356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 343/714] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:18 2022] GET /identity/v3/role_assignments?user.id=b9f911e716994f1f9d4705216ee0f3a5&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:19.090362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f839436-7e0d-48d1-85ab-16da979af600 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:19.090704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f839436-7e0d-48d1-85ab-16da979af600 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:19.091188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f839436-7e0d-48d1-85ab-16da979af600 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:19.092918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 372/715] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:19.098756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0b223-2885-43fa-90aa-8d0697c41c6c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:19.099236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0b223-2885-43fa-90aa-8d0697c41c6c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:19.099311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0b223-2885-43fa-90aa-8d0697c41c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:19.119493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-04a0b223-2885-43fa-90aa-8d0697c41c6c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:19.120698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-04a0b223-2885-43fa-90aa-8d0697c41c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:19.136938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:19.203887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 344/716] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:19.238979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f839436-7e0d-48d1-85ab-16da979af600 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:19.365708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:19.373405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f839436-7e0d-48d1-85ab-16da979af600 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:19.420149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78c8a6-a493-452b-a5c0-e8ee7d793de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:19.420787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c8a6-a493-452b-a5c0-e8ee7d793de2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:19.421063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c8a6-a493-452b-a5c0-e8ee7d793de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:19.421333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c8a6-a493-452b-a5c0-e8ee7d793de2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:19.421966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78c8a6-a493-452b-a5c0-e8ee7d793de2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:19.423355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78c8a6-a493-452b-a5c0-e8ee7d793de2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-3d78c8a6-a493-452b-a5c0-e8ee7d793de2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:19.438538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:19.439539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:19.440765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 373/717] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:19 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:19.446556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0b223-2885-43fa-90aa-8d0697c41c6c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:19.583466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0b223-2885-43fa-90aa-8d0697c41c6c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:19.620005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218b18f-a468-434d-95ad-1cc41f17f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:19.620626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218b18f-a468-434d-95ad-1cc41f17f410 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:19.620907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218b18f-a468-434d-95ad-1cc41f17f410 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:19.621182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218b18f-a468-434d-95ad-1cc41f17f410 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:19.621859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218b18f-a468-434d-95ad-1cc41f17f410 None admin] RBAC: Adding query filter params (name=network) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:19.622166 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218b18f-a468-434d-95ad-1cc41f17f410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:19.623573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218b18f-a468-434d-95ad-1cc41f17f410 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:19.628489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 345/718] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:19.635360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78c8a6-a493-452b-a5c0-e8ee7d793de2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:19.781767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78c8a6-a493-452b-a5c0-e8ee7d793de2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:19.822010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b112c-9858-41fd-ac06-304dea829bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:19.822661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b112c-9858-41fd-ac06-304dea829bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:19.822943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b112c-9858-41fd-ac06-304dea829bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:19.823215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b112c-9858-41fd-ac06-304dea829bf9 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:19.823902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b112c-9858-41fd-ac06-304dea829bf9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:19.824206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b112c-9858-41fd-ac06-304dea829bf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:19.825579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b112c-9858-41fd-ac06-304dea829bf9 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:19.830419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 374/719] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:20.358358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716ab7-b382-4122-b71b-c14ade88597b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:20.358887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716ab7-b382-4122-b71b-c14ade88597b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:20.358993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716ab7-b382-4122-b71b-c14ade88597b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:20.360524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 346/720] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:20.365887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac70ce-8b1d-4dd1-8671-014e26283f06 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:20.366294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac70ce-8b1d-4dd1-8671-014e26283f06 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:20.366500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac70ce-8b1d-4dd1-8671-014e26283f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:20.390499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-23ac70ce-8b1d-4dd1-8671-014e26283f06 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:20.391700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-23ac70ce-8b1d-4dd1-8671-014e26283f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:20.409392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:20.484787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 375/721] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:20.521360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0716ab7-b382-4122-b71b-c14ade88597b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:20.543648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:20.672137 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0716ab7-b382-4122-b71b-c14ade88597b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:20.721132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99402721-d383-4873-bcca-60ae1e674ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:20.722145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99402721-d383-4873-bcca-60ae1e674ade None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:20.722660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99402721-d383-4873-bcca-60ae1e674ade None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:20.723137 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99402721-d383-4873-bcca-60ae1e674ade None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:20.733921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99402721-d383-4873-bcca-60ae1e674ade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-99402721-d383-4873-bcca-60ae1e674ade None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:20.739117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:20.740061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:20.740939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:20.743655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 347/722] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:20.750476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac70ce-8b1d-4dd1-8671-014e26283f06 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:20.930384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac70ce-8b1d-4dd1-8671-014e26283f06 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:20.979343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838de74a-c956-4f1f-b0e7-e9cbc4a1be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:20.979973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838de74a-c956-4f1f-b0e7-e9cbc4a1be40 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:20.980253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838de74a-c956-4f1f-b0e7-e9cbc4a1be40 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:20.980529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838de74a-c956-4f1f-b0e7-e9cbc4a1be40 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:20.981320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838de74a-c956-4f1f-b0e7-e9cbc4a1be40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:20.981628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838de74a-c956-4f1f-b0e7-e9cbc4a1be40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:20.983090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838de74a-c956-4f1f-b0e7-e9cbc4a1be40 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:20.998974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 376/723] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:21.004536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99402721-d383-4873-bcca-60ae1e674ade None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:21.091894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:21.125204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99402721-d383-4873-bcca-60ae1e674ade None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:21.159837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391eaeed-80a8-4589-b47c-2db6bc7b757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:21.160481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eaeed-80a8-4589-b47c-2db6bc7b757f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.160758 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eaeed-80a8-4589-b47c-2db6bc7b757f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.161029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eaeed-80a8-4589-b47c-2db6bc7b757f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.171850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53965d-9d66-4d4b-a62b-225cdd56e646 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.172135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53965d-9d66-4d4b-a62b-225cdd56e646 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.172409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53965d-9d66-4d4b-a62b-225cdd56e646 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.173884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391eaeed-80a8-4589-b47c-2db6bc7b757f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:21.174024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 377/724] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:56:21.175377 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391eaeed-80a8-4589-b47c-2db6bc7b757f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:21.178990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36e940-ae54-41c5-9810-cd7cdba13187 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.179277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36e940-ae54-41c5-9810-cd7cdba13187 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.179557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36e940-ae54-41c5-9810-cd7cdba13187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.198954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-bf36e940-ae54-41c5-9810-cd7cdba13187 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-391eaeed-80a8-4589-b47c-2db6bc7b757f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:21.199124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:21.199944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:21.200939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:21.200939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:21.200939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:21.200939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:21.201159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-bf36e940-ae54-41c5-9810-cd7cdba13187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:21.201242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 348/725] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:21.209414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391eaeed-80a8-4589-b47c-2db6bc7b757f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:21.230785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:21.327222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 378/726] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 01:56:21.354552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36e940-ae54-41c5-9810-cd7cdba13187 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:21.426289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391eaeed-80a8-4589-b47c-2db6bc7b757f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:21.472717 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:21.483851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c8154-1515-46e4-8d3d-6f788b6eb1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:21.484703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c8154-1515-46e4-8d3d-6f788b6eb1fd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.485318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c8154-1515-46e4-8d3d-6f788b6eb1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.485898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c8154-1515-46e4-8d3d-6f788b6eb1fd None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.486713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c8154-1515-46e4-8d3d-6f788b6eb1fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:21.487081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c8154-1515-46e4-8d3d-6f788b6eb1fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:21.487991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36e940-ae54-41c5-9810-cd7cdba13187 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:21.488582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c8154-1515-46e4-8d3d-6f788b6eb1fd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:21.504635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 349/727] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:21.506133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78a778-090c-467f-a433-bc894be52b61 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.506529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78a778-090c-467f-a433-bc894be52b61 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.506872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78a778-090c-467f-a433-bc894be52b61 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.508881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 350/728] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:21.510243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78a778-090c-467f-a433-bc894be52b61 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:21.549636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c3c14-75cc-4e40-b803-9f8838289805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:21.550300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3c14-75cc-4e40-b803-9f8838289805 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.550867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3c14-75cc-4e40-b803-9f8838289805 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.551151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3c14-75cc-4e40-b803-9f8838289805 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.565289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c3c14-75cc-4e40-b803-9f8838289805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-ef3c3c14-75cc-4e40-b803-9f8838289805 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:21.572587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:21.574615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:21.576274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:21.582473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 379/729] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:21.582473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74ce9f-efd4-4ba3-b34a-a18a2611f68f None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.582473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74ce9f-efd4-4ba3-b34a-a18a2611f68f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.582473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74ce9f-efd4-4ba3-b34a-a18a2611f68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.589685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:21.603127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ed74ce9f-efd4-4ba3-b34a-a18a2611f68f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:21.604306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ed74ce9f-efd4-4ba3-b34a-a18a2611f68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:21.638914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78a778-090c-467f-a433-bc894be52b61 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:21.682466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 380/730] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:21.682466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74ce9f-efd4-4ba3-b34a-a18a2611f68f None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:21.685538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edba81-4fc8-47dd-9b4b-39b812969502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:21.686239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edba81-4fc8-47dd-9b4b-39b812969502 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.686610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edba81-4fc8-47dd-9b4b-39b812969502 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.686947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edba81-4fc8-47dd-9b4b-39b812969502 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.695290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edba81-4fc8-47dd-9b4b-39b812969502 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:21.696966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edba81-4fc8-47dd-9b4b-39b812969502 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-61edba81-4fc8-47dd-9b4b-39b812969502 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:21.709996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:21.710995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:21.712496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 351/731] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:21.713103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b65ec2-ef19-42a7-b383-35bc42b9b4c2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.713103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b65ec2-ef19-42a7-b383-35bc42b9b4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.713755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b65ec2-ef19-42a7-b383-35bc42b9b4c2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.718308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 352/732] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:21.718308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b65ec2-ef19-42a7-b383-35bc42b9b4c2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:21.771159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:21.790142 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74ce9f-efd4-4ba3-b34a-a18a2611f68f None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:21.828138 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaef3a-6696-4fc8-b88b-b9526932c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:21.828810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaef3a-6696-4fc8-b88b-b9526932c542 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.829028 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaef3a-6696-4fc8-b88b-b9526932c542 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.829299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaef3a-6696-4fc8-b88b-b9526932c542 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.830021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaef3a-6696-4fc8-b88b-b9526932c542 None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:21.830382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaef3a-6696-4fc8-b88b-b9526932c542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:21.831476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b65ec2-ef19-42a7-b383-35bc42b9b4c2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:21.831784 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaef3a-6696-4fc8-b88b-b9526932c542 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:21.833330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:21.843663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 381/733] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:21.844481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaef3a-6696-4fc8-b88b-b9526932c542 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:21.872237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a7c93-b190-4ba8-87d1-678ea637f195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:21.872893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a7c93-b190-4ba8-87d1-678ea637f195 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.873176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a7c93-b190-4ba8-87d1-678ea637f195 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.873451 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a7c93-b190-4ba8-87d1-678ea637f195 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.889002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a7c93-b190-4ba8-87d1-678ea637f195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f25a7c93-b190-4ba8-87d1-678ea637f195 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:21.898027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:21.899308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:21.900138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:21.900777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 353/734] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:21.903699 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34cc8f-c435-4470-85cb-e5dab7f5d514 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:21.903981 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34cc8f-c435-4470-85cb-e5dab7f5d514 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:21.904255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34cc8f-c435-4470-85cb-e5dab7f5d514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:21.926747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6c34cc8f-c435-4470-85cb-e5dab7f5d514 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:21.927932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6c34cc8f-c435-4470-85cb-e5dab7f5d514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:21.962638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaef3a-6696-4fc8-b88b-b9526932c542 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:21.995775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 354/735] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:21.996606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34cc8f-c435-4470-85cb-e5dab7f5d514 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:22.011561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0500b3-fa53-449d-8cf1-cb8c12bad21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:22.012476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0500b3-fa53-449d-8cf1-cb8c12bad21d None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.012964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0500b3-fa53-449d-8cf1-cb8c12bad21d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.013554 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0500b3-fa53-449d-8cf1-cb8c12bad21d None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.014469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0500b3-fa53-449d-8cf1-cb8c12bad21d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:22.014855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0500b3-fa53-449d-8cf1-cb8c12bad21d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:22.016510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0500b3-fa53-449d-8cf1-cb8c12bad21d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:22.035955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 382/736] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jul 28 01:56:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:22.036926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0500b3-fa53-449d-8cf1-cb8c12bad21d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:22.043864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:22.093997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:22.111866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34cc8f-c435-4470-85cb-e5dab7f5d514 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:22.143080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0500b3-fa53-449d-8cf1-cb8c12bad21d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:22.148236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1af49-f3d2-401f-a516-2f7c3165329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:22.148917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1af49-f3d2-401f-a516-2f7c3165329a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.149299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1af49-f3d2-401f-a516-2f7c3165329a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.149577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1af49-f3d2-401f-a516-2f7c3165329a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.160088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1af49-f3d2-401f-a516-2f7c3165329a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:22.161506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1af49-f3d2-401f-a516-2f7c3165329a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-22c1af49-f3d2-401f-a516-2f7c3165329a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:22.177479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:22.178373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:22.184301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:22.184301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:22.184301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:22.184301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:22.184535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d92e1-1b65-4b21-ab25-0b74181631c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:22.184659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 355/737] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:22.184734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d92e1-1b65-4b21-ab25-0b74181631c5 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.184734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d92e1-1b65-4b21-ab25-0b74181631c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.184734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d92e1-1b65-4b21-ab25-0b74181631c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.184918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1af49-f3d2-401f-a516-2f7c3165329a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:22.184989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d92e1-1b65-4b21-ab25-0b74181631c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:22.184989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d92e1-1b65-4b21-ab25-0b74181631c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:22.184989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d92e1-1b65-4b21-ab25-0b74181631c5 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:22.190747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 383/738] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:22.192116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d92e1-1b65-4b21-ab25-0b74181631c5 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:22.278221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:22.295127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1af49-f3d2-401f-a516-2f7c3165329a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:22.299747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d92e1-1b65-4b21-ab25-0b74181631c5 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:22.317042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:22.332529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f7e70-1913-4cdb-8612-23f2b57fc7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:22.333146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f7e70-1913-4cdb-8612-23f2b57fc7d8 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.333418 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f7e70-1913-4cdb-8612-23f2b57fc7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.333691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f7e70-1913-4cdb-8612-23f2b57fc7d8 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.334374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f7e70-1913-4cdb-8612-23f2b57fc7d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:22.335766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f7e70-1913-4cdb-8612-23f2b57fc7d8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:22.339065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffba42a-277a-479c-a826-892355bf0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:22.339907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffba42a-277a-479c-a826-892355bf0def None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.340440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffba42a-277a-479c-a826-892355bf0def None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.340933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffba42a-277a-479c-a826-892355bf0def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.362473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 356/739] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:56:22 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:22.362473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f7e70-1913-4cdb-8612-23f2b57fc7d8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:22.431871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffba42a-277a-479c-a826-892355bf0def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:22.433345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffba42a-277a-479c-a826-892355bf0def None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:22.507039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f7e70-1913-4cdb-8612-23f2b57fc7d8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:22.546647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865e7ab-52e9-4f82-852f-6f73a0b02a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:22.547211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865e7ab-52e9-4f82-852f-6f73a0b02a24 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.547498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865e7ab-52e9-4f82-852f-6f73a0b02a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.547788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865e7ab-52e9-4f82-852f-6f73a0b02a24 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.548487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865e7ab-52e9-4f82-852f-6f73a0b02a24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:22.548790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865e7ab-52e9-4f82-852f-6f73a0b02a24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:22.548905 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 384/740] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 01:56:22.549713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffba42a-277a-479c-a826-892355bf0def None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:22.550157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865e7ab-52e9-4f82-852f-6f73a0b02a24 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:22.563846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 357/741] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:22.564929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ce4f4-513d-4931-a083-d12a9baa9780 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.565211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ce4f4-513d-4931-a083-d12a9baa9780 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.565485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ce4f4-513d-4931-a083-d12a9baa9780 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.568630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:22.571889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 358/742] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:22.572649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ce4f4-513d-4931-a083-d12a9baa9780 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:22.578464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:22.662311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffba42a-277a-479c-a826-892355bf0def None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:22.695274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ce4f4-513d-4931-a083-d12a9baa9780 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:22.699007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8542-c8b2-463a-b168-3a2cfdc23bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:22.699649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8542-c8b2-463a-b168-3a2cfdc23bca None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.699930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8542-c8b2-463a-b168-3a2cfdc23bca None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.700206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8542-c8b2-463a-b168-3a2cfdc23bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.710363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef8542-c8b2-463a-b168-3a2cfdc23bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:22.712424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef8542-c8b2-463a-b168-3a2cfdc23bca None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-34ef8542-c8b2-463a-b168-3a2cfdc23bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:22.727393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:22.728290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:22.729152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:22.729152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:22.729152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:22.729152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:22.730983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b39216-058e-4b69-af29-4f0095cebd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:22.731624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b39216-058e-4b69-af29-4f0095cebd97 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.731903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b39216-058e-4b69-af29-4f0095cebd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.732169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b39216-058e-4b69-af29-4f0095cebd97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.733128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 385/743] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:22.733999 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8542-c8b2-463a-b168-3a2cfdc23bca None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:22.744316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b39216-058e-4b69-af29-4f0095cebd97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:22.745846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b39216-058e-4b69-af29-4f0095cebd97 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b3b39216-058e-4b69-af29-4f0095cebd97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:22.760565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:22.761635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:22.762888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:22.762888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:22.762888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:22.762888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:22.762888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 359/744] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:22.763162 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5258a8-2b48-40ed-b66b-98c39fa8203b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.763410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5258a8-2b48-40ed-b66b-98c39fa8203b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.763677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5258a8-2b48-40ed-b66b-98c39fa8203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.782315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0c5258a8-2b48-40ed-b66b-98c39fa8203b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:22.783525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0c5258a8-2b48-40ed-b66b-98c39fa8203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:22.812120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:22.845264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:22.850963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8542-c8b2-463a-b168-3a2cfdc23bca None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:22.867511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 360/745] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 01:56:22.868410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5258a8-2b48-40ed-b66b-98c39fa8203b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:22.908264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2888399-1374-4938-b40b-d5f37eb22ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:22.909246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888399-1374-4938-b40b-d5f37eb22ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:22.909711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888399-1374-4938-b40b-d5f37eb22ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:22.910187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888399-1374-4938-b40b-d5f37eb22ae0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:22.918943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2888399-1374-4938-b40b-d5f37eb22ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:22.920395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2888399-1374-4938-b40b-d5f37eb22ae0 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-a2888399-1374-4938-b40b-d5f37eb22ae0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:22.932782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:22.933733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:22.934720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 386/746] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jul 28 01:56:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:22.935998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2888399-1374-4938-b40b-d5f37eb22ae0 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:22.982049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5258a8-2b48-40ed-b66b-98c39fa8203b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:23.018455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0658428-ed93-44aa-845b-ba9cc0fd3274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:23.019104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658428-ed93-44aa-845b-ba9cc0fd3274 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:23.019379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658428-ed93-44aa-845b-ba9cc0fd3274 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:23.019668 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658428-ed93-44aa-845b-ba9cc0fd3274 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:23.020326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0658428-ed93-44aa-845b-ba9cc0fd3274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:23.020625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0658428-ed93-44aa-845b-ba9cc0fd3274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:23.021983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0658428-ed93-44aa-845b-ba9cc0fd3274 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:23.033506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 361/747] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:23.034086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0658428-ed93-44aa-845b-ba9cc0fd3274 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:23.041467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2888399-1374-4938-b40b-d5f37eb22ae0 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:23.067760 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:23.076238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b3a94-af62-463d-9b0f-bb51a73beb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:23.076858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b3a94-af62-463d-9b0f-bb51a73beb81 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:23.077138 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b3a94-af62-463d-9b0f-bb51a73beb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:23.077412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b3a94-af62-463d-9b0f-bb51a73beb81 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:23.078112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b3a94-af62-463d-9b0f-bb51a73beb81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:23.078415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b3a94-af62-463d-9b0f-bb51a73beb81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:23.079808 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b3a94-af62-463d-9b0f-bb51a73beb81 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:23.086008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:23.097147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 387/748] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:23.097147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b3a94-af62-463d-9b0f-bb51a73beb81 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:23.148597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0658428-ed93-44aa-845b-ba9cc0fd3274 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:23.183501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075f5b1-1da5-4d81-a021-1f72302f850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:23.184114 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075f5b1-1da5-4d81-a021-1f72302f850c None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:23.184384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075f5b1-1da5-4d81-a021-1f72302f850c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:23.184663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075f5b1-1da5-4d81-a021-1f72302f850c None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:23.185328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075f5b1-1da5-4d81-a021-1f72302f850c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:23.186708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075f5b1-1da5-4d81-a021-1f72302f850c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:23.200701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b3a94-af62-463d-9b0f-bb51a73beb81 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:23.210683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 362/749] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:56:23 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:23.213076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075f5b1-1da5-4d81-a021-1f72302f850c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:23.256102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10a01-4ead-468c-82ac-678255811caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:23.256879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10a01-4ead-468c-82ac-678255811caa None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:23.257225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10a01-4ead-468c-82ac-678255811caa None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:23.257567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10a01-4ead-468c-82ac-678255811caa None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:23.259121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a10a01-4ead-468c-82ac-678255811caa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:23.259551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a10a01-4ead-468c-82ac-678255811caa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:23.261185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a10a01-4ead-468c-82ac-678255811caa None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:23.285608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 388/750] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jul 28 01:56:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:23.285608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10a01-4ead-468c-82ac-678255811caa None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:23.331322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:23.354236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075f5b1-1da5-4d81-a021-1f72302f850c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:23.363337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:23.397712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10a01-4ead-468c-82ac-678255811caa None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:23.407381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc577d23-dff7-4a66-8331-c27e4c53c5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:23.408624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577d23-dff7-4a66-8331-c27e4c53c5dc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:23.409406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577d23-dff7-4a66-8331-c27e4c53c5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:23.409879 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577d23-dff7-4a66-8331-c27e4c53c5dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:23.422637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc577d23-dff7-4a66-8331-c27e4c53c5dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:23.424090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc577d23-dff7-4a66-8331-c27e4c53c5dc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-fc577d23-dff7-4a66-8331-c27e4c53c5dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:23.437001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:23.438210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:23.439417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:23.439417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:23.439417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:23.439417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:23.439417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:23.439417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:23.439417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:23.439417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:23.439417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:23.439417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:23.441912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 363/751] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jul 28 01:56:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:23.442900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc577d23-dff7-4a66-8331-c27e4c53c5dc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:23.443314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473149ea-e5df-4715-b430-9ac3ec261958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:23.444113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473149ea-e5df-4715-b430-9ac3ec261958 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:23.444537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473149ea-e5df-4715-b430-9ac3ec261958 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:23.444943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473149ea-e5df-4715-b430-9ac3ec261958 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:23.453047 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473149ea-e5df-4715-b430-9ac3ec261958 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:23.454874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473149ea-e5df-4715-b430-9ac3ec261958 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-473149ea-e5df-4715-b430-9ac3ec261958 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:23.467746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:23.468798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:23.469664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:23.469664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:23.469664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:23.469664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:23.469664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:23.469664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:23.469664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:23.469664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:23.471941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 389/752] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:23.472952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473149ea-e5df-4715-b430-9ac3ec261958 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:23.563756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc577d23-dff7-4a66-8331-c27e4c53c5dc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:23.588209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473149ea-e5df-4715-b430-9ac3ec261958 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:23.589911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:23.613411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0f40-5141-4887-ac73-6c23edc59be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:23.614123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0f40-5141-4887-ac73-6c23edc59be9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:23.614489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0f40-5141-4887-ac73-6c23edc59be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:23.614833 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0f40-5141-4887-ac73-6c23edc59be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:23.632845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96fd8c-fd6d-4515-9ad2-2e518f9c639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:23.633891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96fd8c-fd6d-4515-9ad2-2e518f9c639b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:23.634348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96fd8c-fd6d-4515-9ad2-2e518f9c639b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:23.634971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96fd8c-fd6d-4515-9ad2-2e518f9c639b None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:23.636352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96fd8c-fd6d-4515-9ad2-2e518f9c639b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:23.636851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96fd8c-fd6d-4515-9ad2-2e518f9c639b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:23.638870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96fd8c-fd6d-4515-9ad2-2e518f9c639b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:23.659400 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 390/753] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jul 28 01:56:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:23.660561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96fd8c-fd6d-4515-9ad2-2e518f9c639b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:23.661033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:23.706112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac0f40-5141-4887-ac73-6c23edc59be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:23.708073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac0f40-5141-4887-ac73-6c23edc59be9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:23.782065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96fd8c-fd6d-4515-9ad2-2e518f9c639b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:23.817816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 364/754] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:56:23.819261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0f40-5141-4887-ac73-6c23edc59be9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:23.826921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96888e-1448-4e6f-b38f-bc74ceeee281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:23.827620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96888e-1448-4e6f-b38f-bc74ceeee281 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:23.827965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96888e-1448-4e6f-b38f-bc74ceeee281 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:23.828323 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96888e-1448-4e6f-b38f-bc74ceeee281 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:23.829645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96888e-1448-4e6f-b38f-bc74ceeee281 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:23.830018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96888e-1448-4e6f-b38f-bc74ceeee281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:23.831585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96888e-1448-4e6f-b38f-bc74ceeee281 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:23.846148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 391/755] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:23.847245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96888e-1448-4e6f-b38f-bc74ceeee281 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:23.878735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:23.916688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:23.958254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0f40-5141-4887-ac73-6c23edc59be9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:23.984546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96888e-1448-4e6f-b38f-bc74ceeee281 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:24.003614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9a2d4-ae6c-4684-acbf-2345970e30bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:24.004261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9a2d4-ae6c-4684-acbf-2345970e30bd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.004535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9a2d4-ae6c-4684-acbf-2345970e30bd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.004801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9a2d4-ae6c-4684-acbf-2345970e30bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.018832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9a2d4-ae6c-4684-acbf-2345970e30bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:24.020279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9a2d4-ae6c-4684-acbf-2345970e30bd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:24.022722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2098f18-785a-4905-9005-179a1c51474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:24.023624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098f18-785a-4905-9005-179a1c51474d None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.024632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098f18-785a-4905-9005-179a1c51474d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.025097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098f18-785a-4905-9005-179a1c51474d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1ba9a2d4-ae6c-4684-acbf-2345970e30bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:24.037529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:24.038462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:24.040053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:24.040053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:24.040053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:24.040053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:24.040818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 365/756] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:24.041855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2098f18-785a-4905-9005-179a1c51474d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:24.043129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9a2d4-ae6c-4684-acbf-2345970e30bd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:24.043367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2098f18-785a-4905-9005-179a1c51474d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-b2098f18-785a-4905-9005-179a1c51474d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:24.058737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:24.059638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:24.060505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:24.060505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:24.060505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:24.060505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:24.060505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 392/757] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:24.061196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2098f18-785a-4905-9005-179a1c51474d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:24.140539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:24.179277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9a2d4-ae6c-4684-acbf-2345970e30bd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:24.183393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2098f18-785a-4905-9005-179a1c51474d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:24.199971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:24.221591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ff5a0-15f2-4e6d-9d6e-b16c40dd874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:24.222295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ff5a0-15f2-4e6d-9d6e-b16c40dd874a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.222560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83911d53-45c5-4b6e-a3c2-97d86b58e5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:24.222678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ff5a0-15f2-4e6d-9d6e-b16c40dd874a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.223015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ff5a0-15f2-4e6d-9d6e-b16c40dd874a None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.223636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911d53-45c5-4b6e-a3c2-97d86b58e5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.223875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ff5a0-15f2-4e6d-9d6e-b16c40dd874a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:24.224244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ff5a0-15f2-4e6d-9d6e-b16c40dd874a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:24.224462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911d53-45c5-4b6e-a3c2-97d86b58e5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.224955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911d53-45c5-4b6e-a3c2-97d86b58e5b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.225834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ff5a0-15f2-4e6d-9d6e-b16c40dd874a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:24.226107 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83911d53-45c5-4b6e-a3c2-97d86b58e5b5 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=a891bb14f40d403b90915115bc487b03) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:24.226611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83911d53-45c5-4b6e-a3c2-97d86b58e5b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:24.229586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83911d53-45c5-4b6e-a3c2-97d86b58e5b5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:24.243287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 366/758] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:24 2022] GET /identity/v3/role_assignments?user.id=a891bb14f40d403b90915115bc487b03&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:24.243287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83911d53-45c5-4b6e-a3c2-97d86b58e5b5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:24.247404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 393/759] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:24.253154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ff5a0-15f2-4e6d-9d6e-b16c40dd874a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:24.437357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ff5a0-15f2-4e6d-9d6e-b16c40dd874a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:24.440303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83911d53-45c5-4b6e-a3c2-97d86b58e5b5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:24.474659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:24.484669 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e26306-ac6d-41ab-a70d-81f4c68ed98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:24.485312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e26306-ac6d-41ab-a70d-81f4c68ed98e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.485591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e26306-ac6d-41ab-a70d-81f4c68ed98e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.485862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e26306-ac6d-41ab-a70d-81f4c68ed98e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.489123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffc780-1c33-42ac-8182-26ddc2df8879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:24.489743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffc780-1c33-42ac-8182-26ddc2df8879 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.490018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffc780-1c33-42ac-8182-26ddc2df8879 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.490284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffc780-1c33-42ac-8182-26ddc2df8879 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.491012 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffc780-1c33-42ac-8182-26ddc2df8879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:24.491314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffc780-1c33-42ac-8182-26ddc2df8879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:24.493083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffc780-1c33-42ac-8182-26ddc2df8879 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:24.497311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e26306-ac6d-41ab-a70d-81f4c68ed98e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:24.499013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e26306-ac6d-41ab-a70d-81f4c68ed98e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:24.510696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 367/760] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:24.510696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7daa-56ff-4e73-b21c-240b8352fd9a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.510696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7daa-56ff-4e73-b21c-240b8352fd9a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.510696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7daa-56ff-4e73-b21c-240b8352fd9a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.510696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 368/761] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:24.516050 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd359-57b7-4fdb-8a92-65519ee17e59 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.516433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd359-57b7-4fdb-8a92-65519ee17e59 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.516802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd359-57b7-4fdb-8a92-65519ee17e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-a4e26306-ac6d-41ab-a70d-81f4c68ed98e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:24.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:24.519653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:24.520527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:24.520527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:24.520527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:24.520527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:24.520527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:24.520527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:24.520527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:24.520527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:24.522843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 394/762] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:24.524492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e26306-ac6d-41ab-a70d-81f4c68ed98e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:24.548272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-146dd359-57b7-4fdb-8a92-65519ee17e59 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:24.549963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-146dd359-57b7-4fdb-8a92-65519ee17e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:24.597594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:24.654692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e26306-ac6d-41ab-a70d-81f4c68ed98e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:24.694489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fa182-c2b8-47b7-a3ce-7e6a34babae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:24.695072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fa182-c2b8-47b7-a3ce-7e6a34babae2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.695353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fa182-c2b8-47b7-a3ce-7e6a34babae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.695679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fa182-c2b8-47b7-a3ce-7e6a34babae2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.704088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fa182-c2b8-47b7-a3ce-7e6a34babae2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:24.705576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fa182-c2b8-47b7-a3ce-7e6a34babae2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-c98fa182-c2b8-47b7-a3ce-7e6a34babae2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:24.719140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:24.720074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:24.720937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:24.720937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:24.720937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:24.720937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:24.720937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:24.720937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:24.720937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:24.720937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:24.725122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 395/763] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:24.726019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fa182-c2b8-47b7-a3ce-7e6a34babae2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:24.765992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 369/764] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:24.767323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd359-57b7-4fdb-8a92-65519ee17e59 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:24.796115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:24.852349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fa182-c2b8-47b7-a3ce-7e6a34babae2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:24.898300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3fe31-57e6-4830-bb79-961b7049e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:24.899167 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3fe31-57e6-4830-bb79-961b7049e7bb None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.899543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3fe31-57e6-4830-bb79-961b7049e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.900015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3fe31-57e6-4830-bb79-961b7049e7bb None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.900967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3fe31-57e6-4830-bb79-961b7049e7bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:24.901372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3fe31-57e6-4830-bb79-961b7049e7bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:24.903644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd359-57b7-4fdb-8a92-65519ee17e59 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:24.907033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3fe31-57e6-4830-bb79-961b7049e7bb None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:24.921385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 396/765] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:24.922472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3fe31-57e6-4830-bb79-961b7049e7bb None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:24.942390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219b04-4f66-4bff-8239-03bb7ff84560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:24.943039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219b04-4f66-4bff-8239-03bb7ff84560 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:24.943314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219b04-4f66-4bff-8239-03bb7ff84560 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:24.943583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219b04-4f66-4bff-8239-03bb7ff84560 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:24.944335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219b04-4f66-4bff-8239-03bb7ff84560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:24.944696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219b04-4f66-4bff-8239-03bb7ff84560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:24.946764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219b04-4f66-4bff-8239-03bb7ff84560 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:24.964280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 370/766] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:24.965180 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219b04-4f66-4bff-8239-03bb7ff84560 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:24.996533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:25.036907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3fe31-57e6-4830-bb79-961b7049e7bb None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:25.051440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:25.068928 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219b04-4f66-4bff-8239-03bb7ff84560 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:25.077056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30182f-eb11-44e0-bff5-de4fc3639372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:25.077699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30182f-eb11-44e0-bff5-de4fc3639372 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:25.077979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30182f-eb11-44e0-bff5-de4fc3639372 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:25.078246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30182f-eb11-44e0-bff5-de4fc3639372 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:25.079001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30182f-eb11-44e0-bff5-de4fc3639372 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:25.080493 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30182f-eb11-44e0-bff5-de4fc3639372 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-1a30182f-eb11-44e0-bff5-de4fc3639372 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:25.090387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:25.092497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 01:56:25.094606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:25.098783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 397/767] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Jul 28 01:56:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:25.098783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30182f-eb11-44e0-bff5-de4fc3639372 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:25.104921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ac9ef-f566-404c-9721-1e75d77aea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:25.105595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ac9ef-f566-404c-9721-1e75d77aea8d None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:25.105881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ac9ef-f566-404c-9721-1e75d77aea8d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:25.106141 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ac9ef-f566-404c-9721-1e75d77aea8d None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/b9f911e716994f1f9d4705216ee0f3a5/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:25.108155 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ac9ef-f566-404c-9721-1e75d77aea8d None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=b9f911e716994f1f9d4705216ee0f3a5, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:25.109601 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ac9ef-f566-404c-9721-1e75d77aea8d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:25.125166 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 371/768] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:56:24 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/b9f911e716994f1f9d4705216ee0f3a5/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:56:25.126085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ac9ef-f566-404c-9721-1e75d77aea8d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:25.219922 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30182f-eb11-44e0-bff5-de4fc3639372 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:25.262060 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b97dd-ac0d-4be2-b0c7-1ae029714c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:25.263001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b97dd-ac0d-4be2-b0c7-1ae029714c89 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:25.263435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b97dd-ac0d-4be2-b0c7-1ae029714c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:25.263854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b97dd-ac0d-4be2-b0c7-1ae029714c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:25.264838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b97dd-ac0d-4be2-b0c7-1ae029714c89 None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=39169d922474437ebb7605d4a34dd7ec) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:25.265375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b97dd-ac0d-4be2-b0c7-1ae029714c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:25.267057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b97dd-ac0d-4be2-b0c7-1ae029714c89 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:25.275235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 398/769] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:25 2022] GET /identity/v3/role_assignments?user.id=39169d922474437ebb7605d4a34dd7ec&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:25.324454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:25.337794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ac9ef-f566-404c-9721-1e75d77aea8d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:25.351601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a4d71-b774-4098-a974-d6cbd48c697f None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:25.352676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a4d71-b774-4098-a974-d6cbd48c697f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:25.354581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a4d71-b774-4098-a974-d6cbd48c697f None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:25.357086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 399/770] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:56:25.364314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb29e2-f46b-47d6-91dc-71bcfa413d6b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:25.364835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb29e2-f46b-47d6-91dc-71bcfa413d6b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:25.365258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb29e2-f46b-47d6-91dc-71bcfa413d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:25.396912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-50bb29e2-f46b-47d6-91dc-71bcfa413d6b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:25.398371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-50bb29e2-f46b-47d6-91dc-71bcfa413d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:25.405994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd1c6c-810a-4ef6-a5e6-36e7277cc39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:25.406329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd1c6c-810a-4ef6-a5e6-36e7277cc39d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:25.406654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd1c6c-810a-4ef6-a5e6-36e7277cc39d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:25.406939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd1c6c-810a-4ef6-a5e6-36e7277cc39d None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:25.407671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd1c6c-810a-4ef6-a5e6-36e7277cc39d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:25.407981 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd1c6c-810a-4ef6-a5e6-36e7277cc39d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:25.409422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd1c6c-810a-4ef6-a5e6-36e7277cc39d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:25.420281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 372/771] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jul 28 01:56:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:25.432009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd1c6c-810a-4ef6-a5e6-36e7277cc39d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:25.466790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:25.508016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 400/772] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:25.542816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb29e2-f46b-47d6-91dc-71bcfa413d6b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:25.621764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd1c6c-810a-4ef6-a5e6-36e7277cc39d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:25.691247 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d12680-ec2b-48ea-a3d4-5e8c460fecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:25.691880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d12680-ec2b-48ea-a3d4-5e8c460fecf1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:25.692158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d12680-ec2b-48ea-a3d4-5e8c460fecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:25.692431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d12680-ec2b-48ea-a3d4-5e8c460fecf1 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:25.693117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d12680-ec2b-48ea-a3d4-5e8c460fecf1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:25.693420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d12680-ec2b-48ea-a3d4-5e8c460fecf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:25.694812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d12680-ec2b-48ea-a3d4-5e8c460fecf1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:25.707565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 373/773] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jul 28 01:56:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:25.712744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d12680-ec2b-48ea-a3d4-5e8c460fecf1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:25.721780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb29e2-f46b-47d6-91dc-71bcfa413d6b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:25.767144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45f379-2e61-4179-8199-c37cf7bc2b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:25.767709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45f379-2e61-4179-8199-c37cf7bc2b78 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:25.767991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45f379-2e61-4179-8199-c37cf7bc2b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:25.768208 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:25.768311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45f379-2e61-4179-8199-c37cf7bc2b78 None admin] PATH_INFO: `/v3/services/network` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:25.770478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45f379-2e61-4179-8199-c37cf7bc2b78 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:25.771232 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45f379-2e61-4179-8199-c37cf7bc2b78 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-4d45f379-2e61-4179-8199-c37cf7bc2b78 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:25.787337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:25.788372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 01:56:25.789220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:25.797826 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 401/774] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:25 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:25.806015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45f379-2e61-4179-8199-c37cf7bc2b78 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:25.878837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d12680-ec2b-48ea-a3d4-5e8c460fecf1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:25.918484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf4fa1-b0ef-420e-ae54-0c2f51eae8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:25.919373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf4fa1-b0ef-420e-ae54-0c2f51eae8bd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:25.919654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf4fa1-b0ef-420e-ae54-0c2f51eae8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:25.919924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf4fa1-b0ef-420e-ae54-0c2f51eae8bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:25.920683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf4fa1-b0ef-420e-ae54-0c2f51eae8bd None admin] RBAC: Adding query filter params (interface=public, service_id=9de7256d31f74fb1a9a8155ada23fca2, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:25.920990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf4fa1-b0ef-420e-ae54-0c2f51eae8bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:25.922342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf4fa1-b0ef-420e-ae54-0c2f51eae8bd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:25.926790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:25.932281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 374/775] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jul 28 01:56:25 2022] GET /identity/v3/endpoints?service_id=9de7256d31f74fb1a9a8155ada23fca2&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:25.943499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf4fa1-b0ef-420e-ae54-0c2f51eae8bd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:26.005881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45f379-2e61-4179-8199-c37cf7bc2b78 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:26.056706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63095b9d-0f23-46bf-bf0f-6daf5f2ba302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:26.057389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63095b9d-0f23-46bf-bf0f-6daf5f2ba302 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:26.057677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63095b9d-0f23-46bf-bf0f-6daf5f2ba302 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:26.057952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63095b9d-0f23-46bf-bf0f-6daf5f2ba302 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:26.058675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63095b9d-0f23-46bf-bf0f-6daf5f2ba302 None admin] RBAC: Adding query filter params (name=network) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:26.058983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63095b9d-0f23-46bf-bf0f-6daf5f2ba302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:26.060370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63095b9d-0f23-46bf-bf0f-6daf5f2ba302 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:26.065702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 402/776] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:26.072024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63095b9d-0f23-46bf-bf0f-6daf5f2ba302 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:26.087257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:26.115535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf4fa1-b0ef-420e-ae54-0c2f51eae8bd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:26.183587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae207fb0-2d5c-4250-b833-4a82f8259c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:26.184214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207fb0-2d5c-4250-b833-4a82f8259c56 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:26.185186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207fb0-2d5c-4250-b833-4a82f8259c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:26.186721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207fb0-2d5c-4250-b833-4a82f8259c56 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:26.187407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae207fb0-2d5c-4250-b833-4a82f8259c56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:26.188779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae207fb0-2d5c-4250-b833-4a82f8259c56 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:26.195509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 375/777] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jul 28 01:56:25 2022] GET /identity/v3/services => generated 772 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:26.250259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:26.259585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63095b9d-0f23-46bf-bf0f-6daf5f2ba302 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:26.306798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecff24-3b66-48ea-ab30-b56e3a8a6c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:26.307359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecff24-3b66-48ea-ab30-b56e3a8a6c91 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:26.307641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecff24-3b66-48ea-ab30-b56e3a8a6c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:26.307915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecff24-3b66-48ea-ab30-b56e3a8a6c91 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:26.308617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecff24-3b66-48ea-ab30-b56e3a8a6c91 None admin] RBAC: Adding query filter params (type=network) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:26.308928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecff24-3b66-48ea-ab30-b56e3a8a6c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:26.310423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecff24-3b66-48ea-ab30-b56e3a8a6c91 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:26.321608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 403/778] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:26.323975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae207fb0-2d5c-4250-b833-4a82f8259c56 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:26.463809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ecff5-097a-4b36-8a67-831a84683ea5 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:26.464380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ecff5-097a-4b36-8a67-831a84683ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:26.464892 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ecff5-097a-4b36-8a67-831a84683ea5 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:26.467435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 404/779] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:26.471783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae207fb0-2d5c-4250-b833-4a82f8259c56 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:26.472153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a6b1b-9b63-498d-8c0e-7be900a982a5 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:26.472631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a6b1b-9b63-498d-8c0e-7be900a982a5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:26.473206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a6b1b-9b63-498d-8c0e-7be900a982a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:26.493842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-089a6b1b-9b63-498d-8c0e-7be900a982a5 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:26.495370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-089a6b1b-9b63-498d-8c0e-7be900a982a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:26.507964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85b5d4-ed0b-46e8-816b-cf9a1dd8634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:26.509174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85b5d4-ed0b-46e8-816b-cf9a1dd8634d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:26.509437 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85b5d4-ed0b-46e8-816b-cf9a1dd8634d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:26.509706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85b5d4-ed0b-46e8-816b-cf9a1dd8634d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:26.510488 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85b5d4-ed0b-46e8-816b-cf9a1dd8634d None admin] RBAC: Adding query filter params (interface=public, service_id=4c2cb3983736457eb511397c992fdbc8, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:26.510806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85b5d4-ed0b-46e8-816b-cf9a1dd8634d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:26.512168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85b5d4-ed0b-46e8-816b-cf9a1dd8634d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:26.519664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 376/780] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jul 28 01:56:26 2022] GET /identity/v3/endpoints?service_id=4c2cb3983736457eb511397c992fdbc8&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:26.525473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85b5d4-ed0b-46e8-816b-cf9a1dd8634d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:26.547597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:26.638677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 405/781] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:26.659931 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85b5d4-ed0b-46e8-816b-cf9a1dd8634d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:26.685820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a6b1b-9b63-498d-8c0e-7be900a982a5 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:26.706003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f67d5-cba9-482c-8a42-4e66d39c3be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:26.706655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f67d5-cba9-482c-8a42-4e66d39c3be4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:26.706935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f67d5-cba9-482c-8a42-4e66d39c3be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:26.707207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f67d5-cba9-482c-8a42-4e66d39c3be4 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:26.707861 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f67d5-cba9-482c-8a42-4e66d39c3be4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:26.709364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f67d5-cba9-482c-8a42-4e66d39c3be4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:26.714922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 377/782] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jul 28 01:56:26 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:26.885113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a6b1b-9b63-498d-8c0e-7be900a982a5 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:26.888559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:26.940832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193adfd-3b13-4dab-bf2c-ecc3b3d66d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:26.941655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193adfd-3b13-4dab-bf2c-ecc3b3d66d8c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:26.941939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193adfd-3b13-4dab-bf2c-ecc3b3d66d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:26.942211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193adfd-3b13-4dab-bf2c-ecc3b3d66d8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:26.959828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193adfd-3b13-4dab-bf2c-ecc3b3d66d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-8193adfd-3b13-4dab-bf2c-ecc3b3d66d8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:26.965383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:26.966304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:26.967542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 406/783] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:26.973305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f67d5-cba9-482c-8a42-4e66d39c3be4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:27.060739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:27.087576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f67d5-cba9-482c-8a42-4e66d39c3be4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:27.124062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e0a31-050c-49dc-a364-b59d31581a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:27.125117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e0a31-050c-49dc-a364-b59d31581a29 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:27.125615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e0a31-050c-49dc-a364-b59d31581a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:27.126110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e0a31-050c-49dc-a364-b59d31581a29 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:27.127048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e0a31-050c-49dc-a364-b59d31581a29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:27.127548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e0a31-050c-49dc-a364-b59d31581a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:27.129098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e0a31-050c-49dc-a364-b59d31581a29 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:27.139149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 378/784] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:27.146482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193adfd-3b13-4dab-bf2c-ecc3b3d66d8c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:27.301362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193adfd-3b13-4dab-bf2c-ecc3b3d66d8c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:27.349093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131fad4-ae12-498e-93d0-f4d36741cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:27.350086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131fad4-ae12-498e-93d0-f4d36741cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:27.350635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131fad4-ae12-498e-93d0-f4d36741cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:27.351104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131fad4-ae12-498e-93d0-f4d36741cfe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:27.374052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131fad4-ae12-498e-93d0-f4d36741cfe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:27.375845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131fad4-ae12-498e-93d0-f4d36741cfe3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-5131fad4-ae12-498e-93d0-f4d36741cfe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:27.394179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:27.395113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:27.395980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:27.395980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:27.395980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:27.395980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:27.397831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 407/785] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:27.403598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e0a31-050c-49dc-a364-b59d31581a29 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:27.509552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e0a31-050c-49dc-a364-b59d31581a29 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:27.550060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff205af-a675-45eb-abe3-2349f399a978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:27.550722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff205af-a675-45eb-abe3-2349f399a978 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:27.551005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff205af-a675-45eb-abe3-2349f399a978 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:27.551284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff205af-a675-45eb-abe3-2349f399a978 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:27.552037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff205af-a675-45eb-abe3-2349f399a978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:27.552296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff205af-a675-45eb-abe3-2349f399a978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:27.553671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff205af-a675-45eb-abe3-2349f399a978 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:27.564932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:27.570633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 379/786] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:27.576306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131fad4-ae12-498e-93d0-f4d36741cfe3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:27.581998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:27.647469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874eaef-0f69-4e32-98ce-665b3939b013 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:27.647819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874eaef-0f69-4e32-98ce-665b3939b013 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:27.648034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874eaef-0f69-4e32-98ce-665b3939b013 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:27.649679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 380/787] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:56:27.654705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97ea51-dcc9-45e0-9892-92dc21e18380 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:27.654991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97ea51-dcc9-45e0-9892-92dc21e18380 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:27.655270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97ea51-dcc9-45e0-9892-92dc21e18380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:27.694022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131fad4-ae12-498e-93d0-f4d36741cfe3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:27.695452 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-bf97ea51-dcc9-45e0-9892-92dc21e18380 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:27.696697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bf97ea51-dcc9-45e0-9892-92dc21e18380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:27.729814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb54ad-566f-46f4-8284-3296251aad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:27.730470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb54ad-566f-46f4-8284-3296251aad24 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:27.730886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb54ad-566f-46f4-8284-3296251aad24 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:27.731162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb54ad-566f-46f4-8284-3296251aad24 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:27.739201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb54ad-566f-46f4-8284-3296251aad24 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:27.740660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb54ad-566f-46f4-8284-3296251aad24 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-4ddb54ad-566f-46f4-8284-3296251aad24 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:27.752357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:27.753320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:27.754512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 408/788] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:27.763333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb54ad-566f-46f4-8284-3296251aad24 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:27.824265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 381/789] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:27.825571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fc55e-7b05-4428-afe1-677479f14ccc None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:27.825926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fc55e-7b05-4428-afe1-677479f14ccc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:27.826272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fc55e-7b05-4428-afe1-677479f14ccc None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:27.827887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 382/790] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:27.833493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6f5c4-cff8-4c74-a15b-20575ff3cc42 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:27.833770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6f5c4-cff8-4c74-a15b-20575ff3cc42 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:27.834044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6f5c4-cff8-4c74-a15b-20575ff3cc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:27.842873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:27.855024 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-aba6f5c4-cff8-4c74-a15b-20575ff3cc42 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:27.856217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aba6f5c4-cff8-4c74-a15b-20575ff3cc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:27.884013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb54ad-566f-46f4-8284-3296251aad24 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:27.921220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87789a-5247-47b8-badb-f045a1d15487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:27.921954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87789a-5247-47b8-badb-f045a1d15487 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:27.922256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87789a-5247-47b8-badb-f045a1d15487 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:27.922543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87789a-5247-47b8-badb-f045a1d15487 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:27.923345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87789a-5247-47b8-badb-f045a1d15487 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:27.923655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87789a-5247-47b8-badb-f045a1d15487 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:27.925102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87789a-5247-47b8-badb-f045a1d15487 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:27.944275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 409/791] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jul 28 01:56:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:27.945131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87789a-5247-47b8-badb-f045a1d15487 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:27.956960 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 383/792] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:27.956960 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6f5c4-cff8-4c74-a15b-20575ff3cc42 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.022878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:28.074359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6f5c4-cff8-4c74-a15b-20575ff3cc42 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.082422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87789a-5247-47b8-badb-f045a1d15487 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.111307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e310c-8037-4caf-8a3e-cf6266ebaede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.111946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e310c-8037-4caf-8a3e-cf6266ebaede None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.112226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e310c-8037-4caf-8a3e-cf6266ebaede None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.112501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e310c-8037-4caf-8a3e-cf6266ebaede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.112948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:28.123600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e310c-8037-4caf-8a3e-cf6266ebaede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:28.125172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e310c-8037-4caf-8a3e-cf6266ebaede None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:28.128099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6286005-e984-43fd-8fde-c986af0c45fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.128732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6286005-e984-43fd-8fde-c986af0c45fe None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.129009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6286005-e984-43fd-8fde-c986af0c45fe None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.129287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6286005-e984-43fd-8fde-c986af0c45fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.140947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6286005-e984-43fd-8fde-c986af0c45fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-460e310c-8037-4caf-8a3e-cf6266ebaede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:28.145192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:28.146065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:28.147003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:28.147003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:28.147003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:28.147003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-f6286005-e984-43fd-8fde-c986af0c45fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:28.147235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:28.148062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 410/793] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:28.149483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6286005-e984-43fd-8fde-c986af0c45fe None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.152563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 384/794] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:28.153615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e310c-8037-4caf-8a3e-cf6266ebaede None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.260435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e310c-8037-4caf-8a3e-cf6266ebaede None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.265771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6286005-e984-43fd-8fde-c986af0c45fe None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.271737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:28.297669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee7213-4e70-402c-8ec5-6b82ec457050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.298686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee7213-4e70-402c-8ec5-6b82ec457050 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.299189 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee7213-4e70-402c-8ec5-6b82ec457050 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.299664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee7213-4e70-402c-8ec5-6b82ec457050 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.300579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee7213-4e70-402c-8ec5-6b82ec457050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:28.301088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee7213-4e70-402c-8ec5-6b82ec457050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:28.302985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee7213-4e70-402c-8ec5-6b82ec457050 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:28.304397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfdd69-14f9-4a5e-b89a-14a782214f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.305159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfdd69-14f9-4a5e-b89a-14a782214f0e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.305485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfdd69-14f9-4a5e-b89a-14a782214f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.305761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfdd69-14f9-4a5e-b89a-14a782214f0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.313448 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 385/795] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:28.314586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee7213-4e70-402c-8ec5-6b82ec457050 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.318004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfdd69-14f9-4a5e-b89a-14a782214f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-e3bfdd69-14f9-4a5e-b89a-14a782214f0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:28.324425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:28.325341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:28.326182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:28.330423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 411/796] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:28.331434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfdd69-14f9-4a5e-b89a-14a782214f0e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.378652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:28.424234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee7213-4e70-402c-8ec5-6b82ec457050 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.443588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfdd69-14f9-4a5e-b89a-14a782214f0e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.460250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317542c5-60a0-4508-bae1-1aa462c35d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.461164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317542c5-60a0-4508-bae1-1aa462c35d3d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.462174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317542c5-60a0-4508-bae1-1aa462c35d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.462825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317542c5-60a0-4508-bae1-1aa462c35d3d None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.463734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317542c5-60a0-4508-bae1-1aa462c35d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:28.464243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317542c5-60a0-4508-bae1-1aa462c35d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:28.465826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317542c5-60a0-4508-bae1-1aa462c35d3d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:28.483652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 386/797] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:28.483652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317542c5-60a0-4508-bae1-1aa462c35d3d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.484310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0903cd-6e43-4f0b-b852-dc80c4b1cf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.484980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0903cd-6e43-4f0b-b852-dc80c4b1cf93 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.485258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0903cd-6e43-4f0b-b852-dc80c4b1cf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.485527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0903cd-6e43-4f0b-b852-dc80c4b1cf93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.498092 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0903cd-6e43-4f0b-b852-dc80c4b1cf93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:28.499694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0903cd-6e43-4f0b-b852-dc80c4b1cf93 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-4b0903cd-6e43-4f0b-b852-dc80c4b1cf93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:28.515424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:28.516367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:28.517259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:28.517259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:28.517259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:28.517259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:28.517259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 412/798] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:28.518021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0903cd-6e43-4f0b-b852-dc80c4b1cf93 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.522900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:28.600518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317542c5-60a0-4508-bae1-1aa462c35d3d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.625179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:28.634268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0903cd-6e43-4f0b-b852-dc80c4b1cf93 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.638190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44458b6-3988-43ec-9fc0-2807d35934bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.639100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44458b6-3988-43ec-9fc0-2807d35934bc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.639612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44458b6-3988-43ec-9fc0-2807d35934bc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.640090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44458b6-3988-43ec-9fc0-2807d35934bc None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.641009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44458b6-3988-43ec-9fc0-2807d35934bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:28.641514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44458b6-3988-43ec-9fc0-2807d35934bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:28.643131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44458b6-3988-43ec-9fc0-2807d35934bc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:28.652501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 387/799] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:28.653635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44458b6-3988-43ec-9fc0-2807d35934bc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.676539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4370e7-75fa-48c4-8b81-b3bb94e009af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.677171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4370e7-75fa-48c4-8b81-b3bb94e009af None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.677447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4370e7-75fa-48c4-8b81-b3bb94e009af None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.677724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4370e7-75fa-48c4-8b81-b3bb94e009af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.685672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4370e7-75fa-48c4-8b81-b3bb94e009af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:28.687160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4370e7-75fa-48c4-8b81-b3bb94e009af None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-cd4370e7-75fa-48c4-8b81-b3bb94e009af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:28.699667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:28.700685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:28.701594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:28.701594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:28.701594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:28.701594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:28.701594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:28.701594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:28.701594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:28.701594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:28.705591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 413/800] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:28.706574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4370e7-75fa-48c4-8b81-b3bb94e009af None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.760016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:28.767872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44458b6-3988-43ec-9fc0-2807d35934bc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.805267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb074d62-69e5-4e71-a61f-c1ccd2be101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.805979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb074d62-69e5-4e71-a61f-c1ccd2be101b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.806262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb074d62-69e5-4e71-a61f-c1ccd2be101b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.806566 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb074d62-69e5-4e71-a61f-c1ccd2be101b None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.807375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb074d62-69e5-4e71-a61f-c1ccd2be101b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:28.807797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb074d62-69e5-4e71-a61f-c1ccd2be101b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:28.809176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb074d62-69e5-4e71-a61f-c1ccd2be101b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:28.813327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4370e7-75fa-48c4-8b81-b3bb94e009af None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.827250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 388/801] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:28.827250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb074d62-69e5-4e71-a61f-c1ccd2be101b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.854293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afca96-f144-4c40-bf5a-5da1488681d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.854883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afca96-f144-4c40-bf5a-5da1488681d6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.855159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afca96-f144-4c40-bf5a-5da1488681d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.855425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afca96-f144-4c40-bf5a-5da1488681d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.867735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afca96-f144-4c40-bf5a-5da1488681d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:28.869661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afca96-f144-4c40-bf5a-5da1488681d6 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-f5afca96-f144-4c40-bf5a-5da1488681d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:28.888073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:28.889178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:28.890299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:28.890299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:28.890299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:28.890299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:28.894271 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 414/802] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:28.895573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572779b-a5ea-4b43-ba6d-08d992f449be None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.895858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572779b-a5ea-4b43-ba6d-08d992f449be None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.896131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572779b-a5ea-4b43-ba6d-08d992f449be None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.897388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 415/803] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:28.898068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572779b-a5ea-4b43-ba6d-08d992f449be None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:28.909259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:28.944001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb074d62-69e5-4e71-a61f-c1ccd2be101b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:28.988041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04a68-d47b-4deb-9110-2a7a1746c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:28.989016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04a68-d47b-4deb-9110-2a7a1746c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:28.989734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04a68-d47b-4deb-9110-2a7a1746c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:28.990161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04a68-d47b-4deb-9110-2a7a1746c2f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:28.991086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04a68-d47b-4deb-9110-2a7a1746c2f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:28.991543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04a68-d47b-4deb-9110-2a7a1746c2f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:28.993904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04a68-d47b-4deb-9110-2a7a1746c2f2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:29.004485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572779b-a5ea-4b43-ba6d-08d992f449be None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:29.010415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 389/804] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:29.011424 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04a68-d47b-4deb-9110-2a7a1746c2f2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:29.032798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:29.041333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48758114-eca9-4086-ae0a-b25940e43d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:29.041962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48758114-eca9-4086-ae0a-b25940e43d37 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.042378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48758114-eca9-4086-ae0a-b25940e43d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.042644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48758114-eca9-4086-ae0a-b25940e43d37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.051092 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48758114-eca9-4086-ae0a-b25940e43d37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:29.052763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48758114-eca9-4086-ae0a-b25940e43d37 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-48758114-eca9-4086-ae0a-b25940e43d37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:29.064761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:29.065683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:29.066929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 416/805] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jul 28 01:56:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:29.067533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde976-0156-42f7-8f86-4c2a921ff217 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.068138 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde976-0156-42f7-8f86-4c2a921ff217 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.068138 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde976-0156-42f7-8f86-4c2a921ff217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.087460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-56dde976-0156-42f7-8f86-4c2a921ff217 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:29.088831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-56dde976-0156-42f7-8f86-4c2a921ff217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:29.123707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04a68-d47b-4deb-9110-2a7a1746c2f2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:29.146723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:29.155090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 417/806] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:29.155940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dde976-0156-42f7-8f86-4c2a921ff217 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:29.168955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c213f62-a2fc-4760-b733-22dfedc5f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:29.169593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c213f62-a2fc-4760-b733-22dfedc5f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.169865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c213f62-a2fc-4760-b733-22dfedc5f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.170169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c213f62-a2fc-4760-b733-22dfedc5f2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.170902 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c213f62-a2fc-4760-b733-22dfedc5f2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:29.171201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c213f62-a2fc-4760-b733-22dfedc5f2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:29.172564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c213f62-a2fc-4760-b733-22dfedc5f2e0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:29.185880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 390/807] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:29.186785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c213f62-a2fc-4760-b733-22dfedc5f2e0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:29.255913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dde976-0156-42f7-8f86-4c2a921ff217 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:29.262100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:29.286557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c213f62-a2fc-4760-b733-22dfedc5f2e0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:29.289081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4342a-5cb8-44bf-9835-527ea2bf4b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:29.289761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4342a-5cb8-44bf-9835-527ea2bf4b1f None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.290038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4342a-5cb8-44bf-9835-527ea2bf4b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.290311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4342a-5cb8-44bf-9835-527ea2bf4b1f None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/a891bb14f40d403b90915115bc487b03/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.292264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4342a-5cb8-44bf-9835-527ea2bf4b1f None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=a891bb14f40d403b90915115bc487b03, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:29.293710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4342a-5cb8-44bf-9835-527ea2bf4b1f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:29.307214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 418/808] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:56:29 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/a891bb14f40d403b90915115bc487b03/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:56:29.308417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484caef-97bf-4d9f-800a-6b0e296ee8f7 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.308718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484caef-97bf-4d9f-800a-6b0e296ee8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.308970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484caef-97bf-4d9f-800a-6b0e296ee8f7 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.314367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 419/809] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:29.314367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484caef-97bf-4d9f-800a-6b0e296ee8f7 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:29.329140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73921e-f441-4338-a6d7-9a02740b2b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:29.329766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73921e-f441-4338-a6d7-9a02740b2b1c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.330013 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73921e-f441-4338-a6d7-9a02740b2b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.330289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73921e-f441-4338-a6d7-9a02740b2b1c None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.331177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73921e-f441-4338-a6d7-9a02740b2b1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:29.331491 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73921e-f441-4338-a6d7-9a02740b2b1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:29.332985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73921e-f441-4338-a6d7-9a02740b2b1c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:29.354020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 391/810] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jul 28 01:56:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:29.354945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73921e-f441-4338-a6d7-9a02740b2b1c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:29.392344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:29.443168 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484caef-97bf-4d9f-800a-6b0e296ee8f7 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:29.469986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73921e-f441-4338-a6d7-9a02740b2b1c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:29.484059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebba20-098f-43ae-83b7-5ea4972165c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:29.484707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebba20-098f-43ae-83b7-5ea4972165c8 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.484989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebba20-098f-43ae-83b7-5ea4972165c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.485259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebba20-098f-43ae-83b7-5ea4972165c8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.485893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebba20-098f-43ae-83b7-5ea4972165c8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:29.487326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebba20-098f-43ae-83b7-5ea4972165c8 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-07ebba20-098f-43ae-83b7-5ea4972165c8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:29.496888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:29.497900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:29.499087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 420/811] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Jul 28 01:56:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:29.500209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aba7ab-0cbb-4759-94db-8afa6bedae46 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.500209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aba7ab-0cbb-4759-94db-8afa6bedae46 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.500209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aba7ab-0cbb-4759-94db-8afa6bedae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.505869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:29.511969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c418d-2358-4ec8-9de1-fd8939bdc684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:29.512796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c418d-2358-4ec8-9de1-fd8939bdc684 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.513246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c418d-2358-4ec8-9de1-fd8939bdc684 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.513688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c418d-2358-4ec8-9de1-fd8939bdc684 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.520038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-23aba7ab-0cbb-4759-94db-8afa6bedae46 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:29.521232 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-23aba7ab-0cbb-4759-94db-8afa6bedae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:29.521386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c418d-2358-4ec8-9de1-fd8939bdc684 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:29.522915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c418d-2358-4ec8-9de1-fd8939bdc684 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-779c418d-2358-4ec8-9de1-fd8939bdc684 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:29.534979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:29.536116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 392/812] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jul 28 01:56:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:29.537596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c418d-2358-4ec8-9de1-fd8939bdc684 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:29.599046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 421/813] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:29.600275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aba7ab-0cbb-4759-94db-8afa6bedae46 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:29.650691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c418d-2358-4ec8-9de1-fd8939bdc684 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:29.662191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:29.693394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26c85e-a919-48d7-adb0-cc5c98a87433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:29.694133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26c85e-a919-48d7-adb0-cc5c98a87433 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.694413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26c85e-a919-48d7-adb0-cc5c98a87433 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.694725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26c85e-a919-48d7-adb0-cc5c98a87433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.714184 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aba7ab-0cbb-4759-94db-8afa6bedae46 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:29.752447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6ad2b-7cd5-46d6-a522-70044ace98e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:29.753070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6ad2b-7cd5-46d6-a522-70044ace98e4 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.753352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6ad2b-7cd5-46d6-a522-70044ace98e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.753630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6ad2b-7cd5-46d6-a522-70044ace98e4 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.754320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6ad2b-7cd5-46d6-a522-70044ace98e4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:29.754642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6ad2b-7cd5-46d6-a522-70044ace98e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:29.756024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6ad2b-7cd5-46d6-a522-70044ace98e4 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:29.758161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:29.762598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 422/814] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jul 28 01:56:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:29.762598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6ad2b-7cd5-46d6-a522-70044ace98e4 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:29.770506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26c85e-a919-48d7-adb0-cc5c98a87433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:29.771986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26c85e-a919-48d7-adb0-cc5c98a87433 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:29.875836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6ad2b-7cd5-46d6-a522-70044ace98e4 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:29.885792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 393/815] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:56:29.886807 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26c85e-a919-48d7-adb0-cc5c98a87433 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:29.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:29.916482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e8aea-343c-4b84-a2f9-cf545518d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:29.917032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e8aea-343c-4b84-a2f9-cf545518d667 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:29.917311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e8aea-343c-4b84-a2f9-cf545518d667 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:29.917584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e8aea-343c-4b84-a2f9-cf545518d667 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:29.918410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e8aea-343c-4b84-a2f9-cf545518d667 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:29.918746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e8aea-343c-4b84-a2f9-cf545518d667 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:29.920188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e8aea-343c-4b84-a2f9-cf545518d667 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:29.938464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 423/816] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jul 28 01:56:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:29.939287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e8aea-343c-4b84-a2f9-cf545518d667 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:29.996943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:30.007162 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26c85e-a919-48d7-adb0-cc5c98a87433 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.043337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0281823-9f27-4e2b-b727-1e0b521e2cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.044089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0281823-9f27-4e2b-b727-1e0b521e2cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.044370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0281823-9f27-4e2b-b727-1e0b521e2cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.044777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0281823-9f27-4e2b-b727-1e0b521e2cf7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.045381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0281823-9f27-4e2b-b727-1e0b521e2cf7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.046790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0281823-9f27-4e2b-b727-1e0b521e2cf7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:30.047669 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e8aea-343c-4b84-a2f9-cf545518d667 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e0281823-9f27-4e2b-b727-1e0b521e2cf7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:30.056172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:30.057152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:30.057986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 394/817] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:29 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:30.058818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0281823-9f27-4e2b-b727-1e0b521e2cf7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:30.089577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95f56-c14c-4686-a2ed-a176f6cf349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.090352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95f56-c14c-4686-a2ed-a176f6cf349f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.090758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95f56-c14c-4686-a2ed-a176f6cf349f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.091128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95f56-c14c-4686-a2ed-a176f6cf349f None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.091908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95f56-c14c-4686-a2ed-a176f6cf349f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:30.092291 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95f56-c14c-4686-a2ed-a176f6cf349f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.093728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95f56-c14c-4686-a2ed-a176f6cf349f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:30.103494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 424/818] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Jul 28 01:56:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:30.103494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95f56-c14c-4686-a2ed-a176f6cf349f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:30.138724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:30.169879 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0281823-9f27-4e2b-b727-1e0b521e2cf7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.203739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c9b8d-cfff-44a0-95dc-703e0c405830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.204361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c9b8d-cfff-44a0-95dc-703e0c405830 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.204633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c9b8d-cfff-44a0-95dc-703e0c405830 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.204899 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c9b8d-cfff-44a0-95dc-703e0c405830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.206093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95f56-c14c-4686-a2ed-a176f6cf349f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.216018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c9b8d-cfff-44a0-95dc-703e0c405830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.217460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c9b8d-cfff-44a0-95dc-703e0c405830 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b17c9b8d-cfff-44a0-95dc-703e0c405830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:30.232648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:30.233724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:30.239685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:30.239685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:30.239685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:30.239685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:30.239685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 395/819] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:30.239685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c9b8d-cfff-44a0-95dc-703e0c405830 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:30.247984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:30.249787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b79e4-e876-4aca-86ed-ee82326404f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.251149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b79e4-e876-4aca-86ed-ee82326404f7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.251427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b79e4-e876-4aca-86ed-ee82326404f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.251695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b79e4-e876-4aca-86ed-ee82326404f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.262549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b79e4-e876-4aca-86ed-ee82326404f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.263997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b79e4-e876-4aca-86ed-ee82326404f7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-918b79e4-e876-4aca-86ed-ee82326404f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:30.279425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:30.280510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:30.281654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:30.281654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:30.281654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:30.281654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:30.282739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 425/820] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:30.283501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b79e4-e876-4aca-86ed-ee82326404f7 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:30.346320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c9b8d-cfff-44a0-95dc-703e0c405830 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.380640 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c3d63-7518-425f-9b12-90ae2498846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.381258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c3d63-7518-425f-9b12-90ae2498846c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.381543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c3d63-7518-425f-9b12-90ae2498846c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.381822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c3d63-7518-425f-9b12-90ae2498846c None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.382513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:30.382628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c3d63-7518-425f-9b12-90ae2498846c None admin] RBAC: Adding query filter params (name=network) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:30.382818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c3d63-7518-425f-9b12-90ae2498846c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.384816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c3d63-7518-425f-9b12-90ae2498846c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:30.390379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 396/821] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:30.390756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c3d63-7518-425f-9b12-90ae2498846c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:30.400850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b79e4-e876-4aca-86ed-ee82326404f7 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.438225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4ac23-26a1-4434-bdc3-3a3dcf11257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.438779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4ac23-26a1-4434-bdc3-3a3dcf11257e None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.439053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4ac23-26a1-4434-bdc3-3a3dcf11257e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.439322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4ac23-26a1-4434-bdc3-3a3dcf11257e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.440025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4ac23-26a1-4434-bdc3-3a3dcf11257e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.441657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4ac23-26a1-4434-bdc3-3a3dcf11257e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:30.474466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 426/822] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 01:56:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:30.474466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4ac23-26a1-4434-bdc3-3a3dcf11257e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:30.477740 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:30.516039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c3d63-7518-425f-9b12-90ae2498846c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.566587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd44ec8-dd11-43f2-b7bf-a436ff07f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.567373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd44ec8-dd11-43f2-b7bf-a436ff07f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.567711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd44ec8-dd11-43f2-b7bf-a436ff07f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.568087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd44ec8-dd11-43f2-b7bf-a436ff07f5f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.568960 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd44ec8-dd11-43f2-b7bf-a436ff07f5f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:30.569331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd44ec8-dd11-43f2-b7bf-a436ff07f5f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.572521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd44ec8-dd11-43f2-b7bf-a436ff07f5f2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:30.587736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 397/823] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:30.588671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd44ec8-dd11-43f2-b7bf-a436ff07f5f2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:30.616309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4ac23-26a1-4434-bdc3-3a3dcf11257e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.666272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc5809-7326-451d-bc5b-60d101d2111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.666935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5809-7326-451d-bc5b-60d101d2111c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.667211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5809-7326-451d-bc5b-60d101d2111c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.668447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5809-7326-451d-bc5b-60d101d2111c None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.668447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc5809-7326-451d-bc5b-60d101d2111c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:30.668447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc5809-7326-451d-bc5b-60d101d2111c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.670079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc5809-7326-451d-bc5b-60d101d2111c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:30.687634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 427/824] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:30.687634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc5809-7326-451d-bc5b-60d101d2111c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:30.693870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:30.730238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd44ec8-dd11-43f2-b7bf-a436ff07f5f2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.763753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:30.774307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a89e2f-630a-4657-a888-2e969153c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.775093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a89e2f-630a-4657-a888-2e969153c16b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.775985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a89e2f-630a-4657-a888-2e969153c16b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.776356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a89e2f-630a-4657-a888-2e969153c16b None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.777196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a89e2f-630a-4657-a888-2e969153c16b None admin] RBAC: Adding query filter params (type=network) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:30.778038 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a89e2f-630a-4657-a888-2e969153c16b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.780086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a89e2f-630a-4657-a888-2e969153c16b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:30.790539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 398/825] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:30.791473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a89e2f-630a-4657-a888-2e969153c16b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:30.806955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc5809-7326-451d-bc5b-60d101d2111c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.846959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20266dd8-0009-490f-bf4f-eabd3642e816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.847708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266dd8-0009-490f-bf4f-eabd3642e816 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.848045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266dd8-0009-490f-bf4f-eabd3642e816 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.848383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266dd8-0009-490f-bf4f-eabd3642e816 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.855870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20266dd8-0009-490f-bf4f-eabd3642e816 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.857494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20266dd8-0009-490f-bf4f-eabd3642e816 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-20266dd8-0009-490f-bf4f-eabd3642e816 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:30.882223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:30.883941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:30.885015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:30.885015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:30.885015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:30.885015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:30.885015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:30.885015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:30.885015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:30.885015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:30.890217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 428/826] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:30.891249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20266dd8-0009-490f-bf4f-eabd3642e816 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:30.927415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a89e2f-630a-4657-a888-2e969153c16b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:30.960566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:30.978563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569a1f-44e1-46aa-94c8-fced9eab6bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:30.979959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569a1f-44e1-46aa-94c8-fced9eab6bdd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:30.980822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569a1f-44e1-46aa-94c8-fced9eab6bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:30.981290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569a1f-44e1-46aa-94c8-fced9eab6bdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:30.991258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e569a1f-44e1-46aa-94c8-fced9eab6bdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:30.994101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e569a1f-44e1-46aa-94c8-fced9eab6bdd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:31.004015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20266dd8-0009-490f-bf4f-eabd3642e816 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4e569a1f-44e1-46aa-94c8-fced9eab6bdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:31.010946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:31.011835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:31.012719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:31.012719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:31.012719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:31.012719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:31.012719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:31.012719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:31.012719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:31.012719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:31.015245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 399/827] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:31.016174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569a1f-44e1-46aa-94c8-fced9eab6bdd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:31.052409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841080f-bb86-445d-86cf-eda20e0f2392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:31.052993 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841080f-bb86-445d-86cf-eda20e0f2392 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:31.053281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841080f-bb86-445d-86cf-eda20e0f2392 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:31.053555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841080f-bb86-445d-86cf-eda20e0f2392 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:31.054277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841080f-bb86-445d-86cf-eda20e0f2392 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:31.056380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841080f-bb86-445d-86cf-eda20e0f2392 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:31.080968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 429/828] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 01:56:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:31.081910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841080f-bb86-445d-86cf-eda20e0f2392 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:31.083174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:31.138773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569a1f-44e1-46aa-94c8-fced9eab6bdd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:31.184452 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0eb2c-ad46-4adf-b3af-8005a7f1e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:31.185088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0eb2c-ad46-4adf-b3af-8005a7f1e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:31.185366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0eb2c-ad46-4adf-b3af-8005a7f1e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:31.185638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0eb2c-ad46-4adf-b3af-8005a7f1e3b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:31.186539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0eb2c-ad46-4adf-b3af-8005a7f1e3b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:31.186850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0eb2c-ad46-4adf-b3af-8005a7f1e3b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:31.188448 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0eb2c-ad46-4adf-b3af-8005a7f1e3b8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:31.202860 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 400/829] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:31.215638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0eb2c-ad46-4adf-b3af-8005a7f1e3b8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:31.216233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841080f-bb86-445d-86cf-eda20e0f2392 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:31.241715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:31.259567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea1fca-e658-4d64-a596-780395a4c152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:31.260461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea1fca-e658-4d64-a596-780395a4c152 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:31.261013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea1fca-e658-4d64-a596-780395a4c152 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:31.261438 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea1fca-e658-4d64-a596-780395a4c152 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:31.262521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea1fca-e658-4d64-a596-780395a4c152 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:31.263531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea1fca-e658-4d64-a596-780395a4c152 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:31.265313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea1fca-e658-4d64-a596-780395a4c152 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:31.279984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 430/830] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:31.287500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea1fca-e658-4d64-a596-780395a4c152 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:31.385946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0eb2c-ad46-4adf-b3af-8005a7f1e3b8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:31.395825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:31.429116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6148d2-781d-4668-94fa-ec264ff82264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:31.429744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6148d2-781d-4668-94fa-ec264ff82264 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:31.430610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6148d2-781d-4668-94fa-ec264ff82264 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:31.430887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6148d2-781d-4668-94fa-ec264ff82264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:31.431679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6148d2-781d-4668-94fa-ec264ff82264 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=b9f911e716994f1f9d4705216ee0f3a5) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:31.431987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6148d2-781d-4668-94fa-ec264ff82264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:31.432340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea1fca-e658-4d64-a596-780395a4c152 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:31.433416 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6148d2-781d-4668-94fa-ec264ff82264 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:31.440126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 401/831] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:31 2022] GET /identity/v3/role_assignments?user.id=b9f911e716994f1f9d4705216ee0f3a5&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:31.441390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd4c8-cb59-450f-aee4-92b84c2e68e4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:31.441680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd4c8-cb59-450f-aee4-92b84c2e68e4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:31.441952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd4c8-cb59-450f-aee4-92b84c2e68e4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:31.443264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 402/832] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:31.448749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce013-ce83-4e4e-b761-40284e71dcb5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:31.449031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce013-ce83-4e4e-b761-40284e71dcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:31.449304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce013-ce83-4e4e-b761-40284e71dcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:31.468776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b7cce013-ce83-4e4e-b761-40284e71dcb5 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:31.470048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b7cce013-ce83-4e4e-b761-40284e71dcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:31.476414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f7069-4549-46a5-ba9b-9ce20a52b0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:31.477910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f7069-4549-46a5-ba9b-9ce20a52b0cc None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:31.478292 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f7069-4549-46a5-ba9b-9ce20a52b0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:31.478746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f7069-4549-46a5-ba9b-9ce20a52b0cc None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/39169d922474437ebb7605d4a34dd7ec/roles/d8f52393c9554176af3cc338302d1302` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:31.498538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f7069-4549-46a5-ba9b-9ce20a52b0cc None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=39169d922474437ebb7605d4a34dd7ec, role_id=d8f52393c9554176af3cc338302d1302)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:31.500166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f7069-4549-46a5-ba9b-9ce20a52b0cc None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:31.518634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 431/833] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:56:31 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/39169d922474437ebb7605d4a34dd7ec/roles/d8f52393c9554176af3cc338302d1302 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:56:31.562092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 403/834] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:31.589530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f7069-4549-46a5-ba9b-9ce20a52b0cc None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:31.626968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:31.708709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f7069-4549-46a5-ba9b-9ce20a52b0cc None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:31.747884 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f1ed0-e22e-44ff-b224-2dead6c98881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:31.748454 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f1ed0-e22e-44ff-b224-2dead6c98881 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:31.748732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f1ed0-e22e-44ff-b224-2dead6c98881 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:31.749053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f1ed0-e22e-44ff-b224-2dead6c98881 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:31.759693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f1ed0-e22e-44ff-b224-2dead6c98881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-577f1ed0-e22e-44ff-b224-2dead6c98881 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:31.764879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:31.766012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:31.767080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 432/835] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:31.772480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cce013-ce83-4e4e-b761-40284e71dcb5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:31.889104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cce013-ce83-4e4e-b761-40284e71dcb5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:31.890664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:31.925871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be0b7b-fb3b-4eca-bda1-e0172e2a6918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:31.926520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be0b7b-fb3b-4eca-bda1-e0172e2a6918 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:31.926807 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be0b7b-fb3b-4eca-bda1-e0172e2a6918 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:31.927087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be0b7b-fb3b-4eca-bda1-e0172e2a6918 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:31.927809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be0b7b-fb3b-4eca-bda1-e0172e2a6918 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:31.928118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be0b7b-fb3b-4eca-bda1-e0172e2a6918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:31.929489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be0b7b-fb3b-4eca-bda1-e0172e2a6918 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:31.938408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 404/836] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:31.944149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f1ed0-e22e-44ff-b224-2dead6c98881 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:32.043982 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:32.056343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f1ed0-e22e-44ff-b224-2dead6c98881 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:32.094357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae3e29-4d67-43e4-8086-103644a3e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:32.095043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae3e29-4d67-43e4-8086-103644a3e2ed None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:32.095322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae3e29-4d67-43e4-8086-103644a3e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:32.095599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae3e29-4d67-43e4-8086-103644a3e2ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:32.106043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae3e29-4d67-43e4-8086-103644a3e2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:32.107537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae3e29-4d67-43e4-8086-103644a3e2ed None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-32ae3e29-4d67-43e4-8086-103644a3e2ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:32.122614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:32.123525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:32.124417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:32.124417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:32.124417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:32.124417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:32.124417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 433/837] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:32.130913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be0b7b-fb3b-4eca-bda1-e0172e2a6918 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:32.235836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be0b7b-fb3b-4eca-bda1-e0172e2a6918 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:32.271650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb6e45-682d-4ac7-94c2-733fb9e768e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:32.272618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb6e45-682d-4ac7-94c2-733fb9e768e8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:32.273097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb6e45-682d-4ac7-94c2-733fb9e768e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:32.273629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb6e45-682d-4ac7-94c2-733fb9e768e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:32.274547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb6e45-682d-4ac7-94c2-733fb9e768e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:32.275051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb6e45-682d-4ac7-94c2-733fb9e768e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:32.276616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb6e45-682d-4ac7-94c2-733fb9e768e8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:32.289624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 405/838] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:32.295585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae3e29-4d67-43e4-8086-103644a3e2ed None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:32.404853 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae3e29-4d67-43e4-8086-103644a3e2ed None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:32.439608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565ae08-c8a9-49b4-9b53-b497471679b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:32.440556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565ae08-c8a9-49b4-9b53-b497471679b6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:32.441298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565ae08-c8a9-49b4-9b53-b497471679b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:32.441820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565ae08-c8a9-49b4-9b53-b497471679b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:32.450364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565ae08-c8a9-49b4-9b53-b497471679b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:32.452066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565ae08-c8a9-49b4-9b53-b497471679b6 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-c565ae08-c8a9-49b4-9b53-b497471679b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:32.463562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:32.464502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:32.465428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:32.465428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:32.465428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:32.465428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:32.465428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:32.465428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:32.465428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:32.465428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:32.465428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 01:56:32.465428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:32.467911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 434/839] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:32.473749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb6e45-682d-4ac7-94c2-733fb9e768e8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:32.510797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:32.577600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb6e45-682d-4ac7-94c2-733fb9e768e8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:32.612747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c758950-d069-43cb-af91-02084246e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:32.613564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758950-d069-43cb-af91-02084246e302 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:32.613941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758950-d069-43cb-af91-02084246e302 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:32.614353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758950-d069-43cb-af91-02084246e302 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:32.615279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c758950-d069-43cb-af91-02084246e302 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:32.615697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c758950-d069-43cb-af91-02084246e302 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:32.617233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c758950-d069-43cb-af91-02084246e302 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:32.635898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 406/840] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Jul 28 01:56:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:32.641531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565ae08-c8a9-49b4-9b53-b497471679b6 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:32.644737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:32.688983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7a02-53c9-4a4f-831a-f02dfa547ad5 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:32.689410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7a02-53c9-4a4f-831a-f02dfa547ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:32.689782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7a02-53c9-4a4f-831a-f02dfa547ad5 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:32.692099 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 407/841] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:32.697198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3e92e-177e-4580-9bdc-0da6180336b5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:32.697599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3e92e-177e-4580-9bdc-0da6180336b5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:32.697969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3e92e-177e-4580-9bdc-0da6180336b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:32.721086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-93e3e92e-177e-4580-9bdc-0da6180336b5 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:32.722835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-93e3e92e-177e-4580-9bdc-0da6180336b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:32.763151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565ae08-c8a9-49b4-9b53-b497471679b6 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:32.802826 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317966c-24fe-4239-b092-bebb44ae9406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:32.803451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317966c-24fe-4239-b092-bebb44ae9406 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:32.803853 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317966c-24fe-4239-b092-bebb44ae9406 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:32.804124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317966c-24fe-4239-b092-bebb44ae9406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:32.813420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 408/842] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:32.834934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3e92e-177e-4580-9bdc-0da6180336b5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:32.849261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:32.897341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317966c-24fe-4239-b092-bebb44ae9406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:32.899971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317966c-24fe-4239-b092-bebb44ae9406 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:32.901913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:32.938921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3e92e-177e-4580-9bdc-0da6180336b5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:32.974394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168d152-d023-43e1-921d-567e7f3ae1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:32.975199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168d152-d023-43e1-921d-567e7f3ae1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:32.975602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168d152-d023-43e1-921d-567e7f3ae1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:32.975942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168d152-d023-43e1-921d-567e7f3ae1d8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:32.976661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168d152-d023-43e1-921d-567e7f3ae1d8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:32.978689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168d152-d023-43e1-921d-567e7f3ae1d8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0168d152-d023-43e1-921d-567e7f3ae1d8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:32.987678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:32.988876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 01:56:32.989971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:32.992037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 409/843] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:56:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:32.997306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168d152-d023-43e1-921d-567e7f3ae1d8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:33.018852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 435/844] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:56:33.024578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317966c-24fe-4239-b092-bebb44ae9406 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:33.093813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:33.122474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168d152-d023-43e1-921d-567e7f3ae1d8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:33.127321 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317966c-24fe-4239-b092-bebb44ae9406 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:33.128849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:33.163179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6ba98-4477-42ab-b07b-48ae40ed2678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:33.163822 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6ba98-4477-42ab-b07b-48ae40ed2678 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.164101 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6ba98-4477-42ab-b07b-48ae40ed2678 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.164918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f1642-199c-4d66-a26e-d86aefde8410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:33.165056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6ba98-4477-42ab-b07b-48ae40ed2678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.166058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1642-199c-4d66-a26e-d86aefde8410 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.166567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1642-199c-4d66-a26e-d86aefde8410 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.167097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1642-199c-4d66-a26e-d86aefde8410 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.168068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f1642-199c-4d66-a26e-d86aefde8410 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:33.168579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f1642-199c-4d66-a26e-d86aefde8410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:33.170199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f1642-199c-4d66-a26e-d86aefde8410 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:33.175298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6ba98-4477-42ab-b07b-48ae40ed2678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:33.176031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 410/845] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:56:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:33.176823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6ba98-4477-42ab-b07b-48ae40ed2678 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:33.182555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f1642-199c-4d66-a26e-d86aefde8410 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-8cb6ba98-4477-42ab-b07b-48ae40ed2678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:33.192187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:33.193295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:33.194286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:33.194286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:33.194286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:33.194286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:33.198114 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 436/846] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:33.199505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6ba98-4477-42ab-b07b-48ae40ed2678 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:33.300955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f1642-199c-4d66-a26e-d86aefde8410 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:33.301917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6ba98-4477-42ab-b07b-48ae40ed2678 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:33.338155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfc58a-e0f7-47f7-911a-c0b4cfd4c31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:33.339075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfc58a-e0f7-47f7-911a-c0b4cfd4c31e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.339412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfc58a-e0f7-47f7-911a-c0b4cfd4c31e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.339786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfc58a-e0f7-47f7-911a-c0b4cfd4c31e None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.340612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfc58a-e0f7-47f7-911a-c0b4cfd4c31e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:33.340988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfc58a-e0f7-47f7-911a-c0b4cfd4c31e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:33.341398 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc2c03-80e5-4f88-9764-ec73d8f4714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:33.342186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc2c03-80e5-4f88-9764-ec73d8f4714b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.342633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfc58a-e0f7-47f7-911a-c0b4cfd4c31e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:33.342769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc2c03-80e5-4f88-9764-ec73d8f4714b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.343164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc2c03-80e5-4f88-9764-ec73d8f4714b None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.344048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc2c03-80e5-4f88-9764-ec73d8f4714b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:33.344612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc2c03-80e5-4f88-9764-ec73d8f4714b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:33.346258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc2c03-80e5-4f88-9764-ec73d8f4714b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:33.358725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 411/848] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:56:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:33.359923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 437/848] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:33.361046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc2c03-80e5-4f88-9764-ec73d8f4714b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:33.387840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:33.474567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc2c03-80e5-4f88-9764-ec73d8f4714b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:33.511176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bda09-1951-4546-95fb-fb20d4133728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:33.511831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bda09-1951-4546-95fb-fb20d4133728 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.512109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bda09-1951-4546-95fb-fb20d4133728 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.512382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bda09-1951-4546-95fb-fb20d4133728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.520014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bda09-1951-4546-95fb-fb20d4133728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:33.521551 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bda09-1951-4546-95fb-fb20d4133728 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3b3bda09-1951-4546-95fb-fb20d4133728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:33.542791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:33.543751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:33.544653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:33.544653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:33.544653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:33.544653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:33.544653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:33.544653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:33.544653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:33.544653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:33.547224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 412/849] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:33.553480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfc58a-e0f7-47f7-911a-c0b4cfd4c31e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:33.573998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:33.646321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06142b6-3674-45b3-8db3-6a506963a325 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.646659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06142b6-3674-45b3-8db3-6a506963a325 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.646876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06142b6-3674-45b3-8db3-6a506963a325 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.648478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 413/850] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:33.653512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79faf3-ffdd-43b8-b818-a332500d1883 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.653793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79faf3-ffdd-43b8-b818-a332500d1883 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.654071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79faf3-ffdd-43b8-b818-a332500d1883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.670389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfc58a-e0f7-47f7-911a-c0b4cfd4c31e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:33.677789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0e79faf3-ffdd-43b8-b818-a332500d1883 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:33.679024 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0e79faf3-ffdd-43b8-b818-a332500d1883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:33.711857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb962d-3f77-4ccd-b007-7e502719f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:33.712572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb962d-3f77-4ccd-b007-7e502719f4eb None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.712923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb962d-3f77-4ccd-b007-7e502719f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.713202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb962d-3f77-4ccd-b007-7e502719f4eb None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.713951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb962d-3f77-4ccd-b007-7e502719f4eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:33.714257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb962d-3f77-4ccd-b007-7e502719f4eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:33.715862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb962d-3f77-4ccd-b007-7e502719f4eb None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:33.730486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 438/851] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:33.730486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f243e-79cd-45a6-bb81-8054700fc239 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.730486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f243e-79cd-45a6-bb81-8054700fc239 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.730486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f243e-79cd-45a6-bb81-8054700fc239 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.731519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 439/852] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:33.735241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f243e-79cd-45a6-bb81-8054700fc239 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:33.750296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:33.759660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 414/853] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:33.760749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16185b3-cf71-4335-8b11-8fa7f341a99f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.761038 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16185b3-cf71-4335-8b11-8fa7f341a99f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.761310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16185b3-cf71-4335-8b11-8fa7f341a99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.779377 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f16185b3-cf71-4335-8b11-8fa7f341a99f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:33.780574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f16185b3-cf71-4335-8b11-8fa7f341a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:33.840112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:33.858516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 415/854] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:33.858516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16185b3-cf71-4335-8b11-8fa7f341a99f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:33.877729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f243e-79cd-45a6-bb81-8054700fc239 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:33.919494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36427a74-5757-4100-96ff-a42b120ba172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:33.920033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427a74-5757-4100-96ff-a42b120ba172 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:33.920303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427a74-5757-4100-96ff-a42b120ba172 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:33.920574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427a74-5757-4100-96ff-a42b120ba172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:33.921363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427a74-5757-4100-96ff-a42b120ba172 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=a891bb14f40d403b90915115bc487b03) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:33.921669 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427a74-5757-4100-96ff-a42b120ba172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:33.923140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427a74-5757-4100-96ff-a42b120ba172 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:33.938473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 440/855] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:33 2022] GET /identity/v3/role_assignments?user.id=a891bb14f40d403b90915115bc487b03&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:33.938473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36427a74-5757-4100-96ff-a42b120ba172 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:33.982789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16185b3-cf71-4335-8b11-8fa7f341a99f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:34.015373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:34.028665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c509a82-418f-48d1-becb-73896f80c59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:34.029672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c509a82-418f-48d1-becb-73896f80c59d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:34.030175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c509a82-418f-48d1-becb-73896f80c59d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:34.030677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c509a82-418f-48d1-becb-73896f80c59d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:34.044002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c509a82-418f-48d1-becb-73896f80c59d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1c509a82-418f-48d1-becb-73896f80c59d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:34.049669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:34.050851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:56:34.051685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:34.054316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 416/856] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:56:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:34.060010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c509a82-418f-48d1-becb-73896f80c59d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:34.064642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36427a74-5757-4100-96ff-a42b120ba172 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:34.104699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf419827-ca0c-4ab3-b703-324f2136dd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:34.105608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf419827-ca0c-4ab3-b703-324f2136dd7a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:34.105987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf419827-ca0c-4ab3-b703-324f2136dd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:34.106273 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf419827-ca0c-4ab3-b703-324f2136dd7a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:34.107566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf419827-ca0c-4ab3-b703-324f2136dd7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:34.108950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf419827-ca0c-4ab3-b703-324f2136dd7a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-bf419827-ca0c-4ab3-b703-324f2136dd7a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:34.120252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:34.121429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:34.122576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 441/857] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Jul 28 01:56:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:34.128052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf419827-ca0c-4ab3-b703-324f2136dd7a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:34.131879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:34.196281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c509a82-418f-48d1-becb-73896f80c59d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:34.240956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fae37-cb8e-4bca-a25a-95f4a7b69cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:34.241690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fae37-cb8e-4bca-a25a-95f4a7b69cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:34.242010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fae37-cb8e-4bca-a25a-95f4a7b69cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:34.242484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fae37-cb8e-4bca-a25a-95f4a7b69cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:34.243556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fae37-cb8e-4bca-a25a-95f4a7b69cb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:34.244124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fae37-cb8e-4bca-a25a-95f4a7b69cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:34.245497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fae37-cb8e-4bca-a25a-95f4a7b69cb8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:34.245698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf419827-ca0c-4ab3-b703-324f2136dd7a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:34.256052 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 417/858] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:56:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:34.261837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fae37-cb8e-4bca-a25a-95f4a7b69cb8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:34.294992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5ad23-7c42-4cc9-809b-f2b1f13fab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:34.296282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ad23-7c42-4cc9-809b-f2b1f13fab19 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:34.296978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ad23-7c42-4cc9-809b-f2b1f13fab19 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:34.297410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ad23-7c42-4cc9-809b-f2b1f13fab19 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:34.298242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5ad23-7c42-4cc9-809b-f2b1f13fab19 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:34.298735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5ad23-7c42-4cc9-809b-f2b1f13fab19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:34.301231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5ad23-7c42-4cc9-809b-f2b1f13fab19 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:34.306776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 442/859] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:34.312063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5ad23-7c42-4cc9-809b-f2b1f13fab19 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:34.315718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:34.375978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fae37-cb8e-4bca-a25a-95f4a7b69cb8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:34.402886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:34.412691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9d67-5769-4094-a265-96a72ec02e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:34.413450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9d67-5769-4094-a265-96a72ec02e88 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:34.413808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9d67-5769-4094-a265-96a72ec02e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:34.414617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9d67-5769-4094-a265-96a72ec02e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:34.427080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf9d67-5769-4094-a265-96a72ec02e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:34.428713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf9d67-5769-4094-a265-96a72ec02e88 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:34.435127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5ad23-7c42-4cc9-809b-f2b1f13fab19 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8acf9d67-5769-4094-a265-96a72ec02e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:34.444560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:34.445472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:34.447653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:34.447653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:34.447653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:34.447653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:34.451189 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 418/860] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:34.452504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9d67-5769-4094-a265-96a72ec02e88 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:34.474208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41329ae9-638f-4a39-ae3b-0f8c92dc2703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:34.475207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329ae9-638f-4a39-ae3b-0f8c92dc2703 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:34.475693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329ae9-638f-4a39-ae3b-0f8c92dc2703 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:34.476165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329ae9-638f-4a39-ae3b-0f8c92dc2703 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:34.477112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41329ae9-638f-4a39-ae3b-0f8c92dc2703 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:34.477620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41329ae9-638f-4a39-ae3b-0f8c92dc2703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:34.479246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41329ae9-638f-4a39-ae3b-0f8c92dc2703 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:34.484807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 443/861] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:34.570264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:34.576031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9d67-5769-4094-a265-96a72ec02e88 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:34.616469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae61a0-ec73-46ea-8371-53076fe714af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:34.617160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae61a0-ec73-46ea-8371-53076fe714af None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:34.617988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae61a0-ec73-46ea-8371-53076fe714af None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:34.618282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae61a0-ec73-46ea-8371-53076fe714af None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:34.619014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae61a0-ec73-46ea-8371-53076fe714af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:34.619324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae61a0-ec73-46ea-8371-53076fe714af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:34.620728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae61a0-ec73-46ea-8371-53076fe714af None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:34.638577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 419/862] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:34.640962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41329ae9-638f-4a39-ae3b-0f8c92dc2703 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:34.748133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41329ae9-638f-4a39-ae3b-0f8c92dc2703 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:34.777563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:34.783384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3206ab-7b3b-4fca-8c43-2b552bc14d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:34.784037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3206ab-7b3b-4fca-8c43-2b552bc14d63 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:34.784571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3206ab-7b3b-4fca-8c43-2b552bc14d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:34.784847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3206ab-7b3b-4fca-8c43-2b552bc14d63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:34.793484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3206ab-7b3b-4fca-8c43-2b552bc14d63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:34.795010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3206ab-7b3b-4fca-8c43-2b552bc14d63 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-5f3206ab-7b3b-4fca-8c43-2b552bc14d63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:34.807280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:34.808252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:34.809170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:34.809170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:34.809170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:34.809170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:34.809170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:34.809170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:34.809170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:34.809170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:34.809170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:34.809170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:34.813311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 444/863] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jul 28 01:56:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:34.814721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae61a0-ec73-46ea-8371-53076fe714af None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:34.934957 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae61a0-ec73-46ea-8371-53076fe714af None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:34.971426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c337f7-b529-4bd5-93b7-18dcb07ba504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:34.972119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c337f7-b529-4bd5-93b7-18dcb07ba504 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:34.972401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c337f7-b529-4bd5-93b7-18dcb07ba504 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:34.972679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c337f7-b529-4bd5-93b7-18dcb07ba504 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:34.973527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c337f7-b529-4bd5-93b7-18dcb07ba504 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:34.973837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c337f7-b529-4bd5-93b7-18dcb07ba504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:34.975307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c337f7-b529-4bd5-93b7-18dcb07ba504 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:34.998624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 420/864] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jul 28 01:56:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:35.000930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3206ab-7b3b-4fca-8c43-2b552bc14d63 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:35.109002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3206ab-7b3b-4fca-8c43-2b552bc14d63 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:35.144697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c093b-9dbb-4baf-b649-26b9a8be5e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:35.146134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c093b-9dbb-4baf-b649-26b9a8be5e9b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:35.146660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c093b-9dbb-4baf-b649-26b9a8be5e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:35.147133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c093b-9dbb-4baf-b649-26b9a8be5e9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:35.215927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:35.227447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c093b-9dbb-4baf-b649-26b9a8be5e9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:35.229510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c093b-9dbb-4baf-b649-26b9a8be5e9b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:35.333278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 445/865] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:56:35.339298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c337f7-b529-4bd5-93b7-18dcb07ba504 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:35.358949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:35.446164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c337f7-b529-4bd5-93b7-18dcb07ba504 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:35.459640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73b751-8b3d-4a86-b234-df1f96e0c377 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:35.459920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73b751-8b3d-4a86-b234-df1f96e0c377 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:35.460203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73b751-8b3d-4a86-b234-df1f96e0c377 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:35.462343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 446/866] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:35.467021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def871-3a85-4ca4-9296-830ceeef3efc None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:35.467298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def871-3a85-4ca4-9296-830ceeef3efc None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:35.467570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def871-3a85-4ca4-9296-830ceeef3efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:35.485829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbeb94-eb60-4b47-bf7c-c23c6ab6e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:35.486838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbeb94-eb60-4b47-bf7c-c23c6ab6e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:35.487343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbeb94-eb60-4b47-bf7c-c23c6ab6e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:35.487822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbeb94-eb60-4b47-bf7c-c23c6ab6e9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:35.487945 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-57def871-3a85-4ca4-9296-830ceeef3efc None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:35.489117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-57def871-3a85-4ca4-9296-830ceeef3efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:35.499393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbeb94-eb60-4b47-bf7c-c23c6ab6e9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:35.501111 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbeb94-eb60-4b47-bf7c-c23c6ab6e9c7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-47cbeb94-eb60-4b47-bf7c-c23c6ab6e9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:35.520776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:35.521724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:35.522679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:35.522679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:35.522679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:35.522679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:35.529115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 421/867] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:35.530777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbeb94-eb60-4b47-bf7c-c23c6ab6e9c7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:35.568131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 447/868] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:35.594893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57def871-3a85-4ca4-9296-830ceeef3efc None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:35.618571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:35.619267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:35.657670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbeb94-eb60-4b47-bf7c-c23c6ab6e9c7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:35.706986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12420d3c-ffcb-4da6-a737-bd82cb0bb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:35.707855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12420d3c-ffcb-4da6-a737-bd82cb0bb111 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:35.708547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12420d3c-ffcb-4da6-a737-bd82cb0bb111 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:35.708825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12420d3c-ffcb-4da6-a737-bd82cb0bb111 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:35.709839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12420d3c-ffcb-4da6-a737-bd82cb0bb111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:35.710148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12420d3c-ffcb-4da6-a737-bd82cb0bb111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:35.712575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12420d3c-ffcb-4da6-a737-bd82cb0bb111 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:35.714655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57def871-3a85-4ca4-9296-830ceeef3efc None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:35.731086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 422/869] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:35.736469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12420d3c-ffcb-4da6-a737-bd82cb0bb111 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:35.763218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedcd90-23d7-4627-af43-8595dad5866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:35.764361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedcd90-23d7-4627-af43-8595dad5866d None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:35.765069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedcd90-23d7-4627-af43-8595dad5866d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:35.765557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedcd90-23d7-4627-af43-8595dad5866d None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:35.767164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedcd90-23d7-4627-af43-8595dad5866d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:35.769380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedcd90-23d7-4627-af43-8595dad5866d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:35.793990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 448/870] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:56:35 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 01:56:35.849661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12420d3c-ffcb-4da6-a737-bd82cb0bb111 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:35.880093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:35.896047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47c793-5f53-4ea3-8ae9-a3f6ab386a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:35.897010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47c793-5f53-4ea3-8ae9-a3f6ab386a72 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:35.897470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47c793-5f53-4ea3-8ae9-a3f6ab386a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:35.897917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47c793-5f53-4ea3-8ae9-a3f6ab386a72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:35.906475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47c793-5f53-4ea3-8ae9-a3f6ab386a72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:35.908229 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47c793-5f53-4ea3-8ae9-a3f6ab386a72 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6b47c793-5f53-4ea3-8ae9-a3f6ab386a72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:35.921143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:35.922160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:35.923143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:35.923143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:35.923143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:35.923143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:35.923143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:35.923143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:35.923143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:35.923143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:35.925340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 423/871] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:35.931835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedcd90-23d7-4627-af43-8595dad5866d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:36.028705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:36.049876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedcd90-23d7-4627-af43-8595dad5866d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:36.085875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667166f5-c5bd-4ef7-b70a-bc7e40547435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:36.086550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667166f5-c5bd-4ef7-b70a-bc7e40547435 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:36.086831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667166f5-c5bd-4ef7-b70a-bc7e40547435 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:36.087102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667166f5-c5bd-4ef7-b70a-bc7e40547435 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:36.087854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667166f5-c5bd-4ef7-b70a-bc7e40547435 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:36.088248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667166f5-c5bd-4ef7-b70a-bc7e40547435 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:36.089699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667166f5-c5bd-4ef7-b70a-bc7e40547435 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:36.103924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151be88a-736b-40fe-9b30-a594a66187f1 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:36.104421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151be88a-736b-40fe-9b30-a594a66187f1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:36.104421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151be88a-736b-40fe-9b30-a594a66187f1 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:36.105830 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 424/873] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:36.105937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 449/873] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:36.108330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151be88a-736b-40fe-9b30-a594a66187f1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:36.111714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b2d9-a6fe-43fe-abfc-016d6469ffe0 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:36.112886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b2d9-a6fe-43fe-abfc-016d6469ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:36.112886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b2d9-a6fe-43fe-abfc-016d6469ffe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:36.131958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-2309b2d9-a6fe-43fe-abfc-016d6469ffe0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:36.133747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2309b2d9-a6fe-43fe-abfc-016d6469ffe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:36.208847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 450/874] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:36.231348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309b2d9-a6fe-43fe-abfc-016d6469ffe0 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:36.246809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151be88a-736b-40fe-9b30-a594a66187f1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:36.293616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187d37-d9a5-43d4-a924-dfddd530d85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:36.295142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187d37-d9a5-43d4-a924-dfddd530d85c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:36.295635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187d37-d9a5-43d4-a924-dfddd530d85c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:36.296363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187d37-d9a5-43d4-a924-dfddd530d85c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:36.297783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44187d37-d9a5-43d4-a924-dfddd530d85c None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=39169d922474437ebb7605d4a34dd7ec) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:36.298746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44187d37-d9a5-43d4-a924-dfddd530d85c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:36.300974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44187d37-d9a5-43d4-a924-dfddd530d85c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:36.311202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 425/875] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:36 2022] GET /identity/v3/role_assignments?user.id=39169d922474437ebb7605d4a34dd7ec&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:36.312739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:36.354967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309b2d9-a6fe-43fe-abfc-016d6469ffe0 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:36.393798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533192-fc0d-4f0c-b921-1eaad6137591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:36.394485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533192-fc0d-4f0c-b921-1eaad6137591 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:36.394769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533192-fc0d-4f0c-b921-1eaad6137591 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:36.395043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533192-fc0d-4f0c-b921-1eaad6137591 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:36.395709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58533192-fc0d-4f0c-b921-1eaad6137591 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:36.397146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58533192-fc0d-4f0c-b921-1eaad6137591 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-58533192-fc0d-4f0c-b921-1eaad6137591 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:36.407096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:36.408160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:36.408994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 451/876] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:36.417447 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187d37-d9a5-43d4-a924-dfddd530d85c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:36.473892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:36.529974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187d37-d9a5-43d4-a924-dfddd530d85c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:36.567224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170420d0-596e-4291-a207-376f0b4cfe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:36.568223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170420d0-596e-4291-a207-376f0b4cfe24 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:36.568726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170420d0-596e-4291-a207-376f0b4cfe24 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:36.569201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170420d0-596e-4291-a207-376f0b4cfe24 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:36.570086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170420d0-596e-4291-a207-376f0b4cfe24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:36.570762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170420d0-596e-4291-a207-376f0b4cfe24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:36.572342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170420d0-596e-4291-a207-376f0b4cfe24 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:36.577762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 426/877] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jul 28 01:56:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:36.583837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533192-fc0d-4f0c-b921-1eaad6137591 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:36.667087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b56c2-dc04-4982-a5a5-cfc13474ef00 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:36.667757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b56c2-dc04-4982-a5a5-cfc13474ef00 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:36.668259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b56c2-dc04-4982-a5a5-cfc13474ef00 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:36.670159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 427/878] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:56:36.675125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eb1ea-bbf1-4b05-8f3e-ff0bf4b42ae9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:36.675642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eb1ea-bbf1-4b05-8f3e-ff0bf4b42ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:36.676150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eb1ea-bbf1-4b05-8f3e-ff0bf4b42ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:36.689908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533192-fc0d-4f0c-b921-1eaad6137591 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:36.698819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f88eb1ea-bbf1-4b05-8f3e-ff0bf4b42ae9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:36.700757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f88eb1ea-bbf1-4b05-8f3e-ff0bf4b42ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:36.727396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83060977-136b-43fb-b492-c0773cf8be05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:36.728017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83060977-136b-43fb-b492-c0773cf8be05 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:36.728295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83060977-136b-43fb-b492-c0773cf8be05 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:36.728570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83060977-136b-43fb-b492-c0773cf8be05 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:36.729253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83060977-136b-43fb-b492-c0773cf8be05 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:36.729560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83060977-136b-43fb-b492-c0773cf8be05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:36.731051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83060977-136b-43fb-b492-c0773cf8be05 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:36.732500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:36.742774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 452/879] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jul 28 01:56:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:36.786627 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 428/880] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:36.809621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83060977-136b-43fb-b492-c0773cf8be05 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:36.923396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83060977-136b-43fb-b492-c0773cf8be05 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:36.962428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb1785-d707-41a7-8ea5-c8cb12e72bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:36.963130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb1785-d707-41a7-8ea5-c8cb12e72bae None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:36.963417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb1785-d707-41a7-8ea5-c8cb12e72bae None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:36.963692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb1785-d707-41a7-8ea5-c8cb12e72bae None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:36.964403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb1785-d707-41a7-8ea5-c8cb12e72bae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:36.965832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb1785-d707-41a7-8ea5-c8cb12e72bae None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:36.984098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 453/881] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:56:36 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:37.903673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb64b-abdc-42b4-af9b-c395647c7b8d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:37.904656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb64b-abdc-42b4-af9b-c395647c7b8d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:37.905158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb64b-abdc-42b4-af9b-c395647c7b8d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:37.907000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 429/882] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:37.912270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194102a8-b979-45e1-bbe3-98278814e5ae None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:37.913086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194102a8-b979-45e1-bbe3-98278814e5ae None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:37.913568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194102a8-b979-45e1-bbe3-98278814e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:37.931773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-194102a8-b979-45e1-bbe3-98278814e5ae None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:37.933237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-194102a8-b979-45e1-bbe3-98278814e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:37.988065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:38.011066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 454/883] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:38.034909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb64b-abdc-42b4-af9b-c395647c7b8d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:38.079688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:38.144427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb64b-abdc-42b4-af9b-c395647c7b8d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:38.183982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568059d-a97b-4493-8a3e-361bfa7989ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:38.184626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568059d-a97b-4493-8a3e-361bfa7989ac None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.184907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568059d-a97b-4493-8a3e-361bfa7989ac None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.185179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568059d-a97b-4493-8a3e-361bfa7989ac None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.185806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568059d-a97b-4493-8a3e-361bfa7989ac None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:38.187200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568059d-a97b-4493-8a3e-361bfa7989ac None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-2568059d-a97b-4493-8a3e-361bfa7989ac None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:38.197259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:38.198476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:38.199354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 430/884] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:56:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:38.204695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194102a8-b979-45e1-bbe3-98278814e5ae None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:38.309296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194102a8-b979-45e1-bbe3-98278814e5ae None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:38.344181 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bfbf0-fbcd-4871-8a22-30b1518abf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:38.344806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bfbf0-fbcd-4871-8a22-30b1518abf12 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.345083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bfbf0-fbcd-4871-8a22-30b1518abf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.345353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bfbf0-fbcd-4871-8a22-30b1518abf12 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.346036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bfbf0-fbcd-4871-8a22-30b1518abf12 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:38.346334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bfbf0-fbcd-4871-8a22-30b1518abf12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:38.347736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bfbf0-fbcd-4871-8a22-30b1518abf12 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:38.352962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 455/885] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:56:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:38.358351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568059d-a97b-4493-8a3e-361bfa7989ac None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:38.465204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568059d-a97b-4493-8a3e-361bfa7989ac None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:38.472806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:38.493227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc8be7-8c3e-4475-9c55-31ed45cb96b7 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.493457 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc8be7-8c3e-4475-9c55-31ed45cb96b7 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.493679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc8be7-8c3e-4475-9c55-31ed45cb96b7 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.498737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 456/886] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:38.500423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e26b4-94db-49d5-83ab-d2e568809003 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.500704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e26b4-94db-49d5-83ab-d2e568809003 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.500977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e26b4-94db-49d5-83ab-d2e568809003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.503461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a758f8-22b7-496e-ba23-4ea0cf2ebc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:38.504310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a758f8-22b7-496e-ba23-4ea0cf2ebc68 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.504791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a758f8-22b7-496e-ba23-4ea0cf2ebc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.505262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a758f8-22b7-496e-ba23-4ea0cf2ebc68 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.506194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a758f8-22b7-496e-ba23-4ea0cf2ebc68 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:38.506778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a758f8-22b7-496e-ba23-4ea0cf2ebc68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:38.508923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a758f8-22b7-496e-ba23-4ea0cf2ebc68 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:38.518567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 431/887] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:56:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:38.520254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-b83e26b4-94db-49d5-83ab-d2e568809003 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:38.520684 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a758f8-22b7-496e-ba23-4ea0cf2ebc68 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:38.521525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b83e26b4-94db-49d5-83ab-d2e568809003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:38.594826 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:38.598551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 457/888] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:38.620513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e26b4-94db-49d5-83ab-d2e568809003 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:38.626976 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a758f8-22b7-496e-ba23-4ea0cf2ebc68 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:38.671049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c62ac-39e2-4cf2-94e7-5b3236b62ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:38.672052 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c62ac-39e2-4cf2-94e7-5b3236b62ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.672532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c62ac-39e2-4cf2-94e7-5b3236b62ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.673006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c62ac-39e2-4cf2-94e7-5b3236b62ed0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.673963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c62ac-39e2-4cf2-94e7-5b3236b62ed0 None admin] RBAC: Adding query filter params (interface=public, service_id=4098f96cb7694cbfb8414dcf42e4a1f7, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:38.674591 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c62ac-39e2-4cf2-94e7-5b3236b62ed0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:38.676155 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c62ac-39e2-4cf2-94e7-5b3236b62ed0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:38.686971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 432/889] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jul 28 01:56:38 2022] GET /identity/v3/endpoints?service_id=4098f96cb7694cbfb8414dcf42e4a1f7&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:38.688194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c62ac-39e2-4cf2-94e7-5b3236b62ed0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:38.723858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:38.730215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e26b4-94db-49d5-83ab-d2e568809003 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:38.767256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56927d34-373e-4dc3-bb08-bf9731bca815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:38.767908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56927d34-373e-4dc3-bb08-bf9731bca815 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.768184 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56927d34-373e-4dc3-bb08-bf9731bca815 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.768448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56927d34-373e-4dc3-bb08-bf9731bca815 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.779726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56927d34-373e-4dc3-bb08-bf9731bca815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-56927d34-373e-4dc3-bb08-bf9731bca815 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:38.784859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:38.785795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:56:38.786653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:38.791473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 458/890] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jul 28 01:56:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:38.792745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56927d34-373e-4dc3-bb08-bf9731bca815 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:38.799582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c62ac-39e2-4cf2-94e7-5b3236b62ed0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:38.835752 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:38.837563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129f571-eb96-407a-8b15-27a9f1450cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:38.838284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129f571-eb96-407a-8b15-27a9f1450cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.838625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129f571-eb96-407a-8b15-27a9f1450cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.838919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129f571-eb96-407a-8b15-27a9f1450cf7 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.839924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129f571-eb96-407a-8b15-27a9f1450cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:38.841634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129f571-eb96-407a-8b15-27a9f1450cf7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:38.854528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 433/891] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jul 28 01:56:38 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 01:56:38.854528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c69db5-511b-4aa7-9868-9e0c1375f211 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.854528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c69db5-511b-4aa7-9868-9e0c1375f211 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.854528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c69db5-511b-4aa7-9868-9e0c1375f211 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.854917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 434/892] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:38.859450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd30f3a-a278-4993-9137-0238227fbe65 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.859737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd30f3a-a278-4993-9137-0238227fbe65 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.859993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd30f3a-a278-4993-9137-0238227fbe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.885575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3cd30f3a-a278-4993-9137-0238227fbe65 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:38.886879 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3cd30f3a-a278-4993-9137-0238227fbe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:38.919857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56927d34-373e-4dc3-bb08-bf9731bca815 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:38.960745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd46f36-06d3-4a8a-b321-58da4a62ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:38.962009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd46f36-06d3-4a8a-b321-58da4a62ddd5 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:38.962369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd46f36-06d3-4a8a-b321-58da4a62ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:38.962669 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd46f36-06d3-4a8a-b321-58da4a62ddd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:38.963403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd46f36-06d3-4a8a-b321-58da4a62ddd5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:38.963704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd46f36-06d3-4a8a-b321-58da4a62ddd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:38.965252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd46f36-06d3-4a8a-b321-58da4a62ddd5 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:38.970623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 435/893] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:38.983992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 459/894] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jul 28 01:56:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:38.985561 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd30f3a-a278-4993-9137-0238227fbe65 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:38.989170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd46f36-06d3-4a8a-b321-58da4a62ddd5 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:39.018513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:39.101485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:39.105245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd46f36-06d3-4a8a-b321-58da4a62ddd5 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:39.105466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd30f3a-a278-4993-9137-0238227fbe65 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:39.143061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae236b3-e2bf-4f1e-93b3-8181f3bf9c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:39.143675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae236b3-e2bf-4f1e-93b3-8181f3bf9c21 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.143985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae236b3-e2bf-4f1e-93b3-8181f3bf9c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.144220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae236b3-e2bf-4f1e-93b3-8181f3bf9c21 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:39.144605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73c57e-9481-4139-b6c8-1110064d6ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:39.144911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae236b3-e2bf-4f1e-93b3-8181f3bf9c21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:39.145244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73c57e-9481-4139-b6c8-1110064d6ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.145524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73c57e-9481-4139-b6c8-1110064d6ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.145800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73c57e-9481-4139-b6c8-1110064d6ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:39.146328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae236b3-e2bf-4f1e-93b3-8181f3bf9c21 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:39.157321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73c57e-9481-4139-b6c8-1110064d6ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:39.158815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73c57e-9481-4139-b6c8-1110064d6ea7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:39.162474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 460/895] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:56:38 2022] POST /identity/v3/services => generated 241 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:39.163797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11556-10e9-442c-a574-27efa9cd8982 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.164671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11556-10e9-442c-a574-27efa9cd8982 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.164937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11556-10e9-442c-a574-27efa9cd8982 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:39.166300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 461/896] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:39.172762 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352da01-c49e-4cd1-8c59-a3656ce9b440 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.173567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352da01-c49e-4cd1-8c59-a3656ce9b440 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.173847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352da01-c49e-4cd1-8c59-a3656ce9b440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7a73c57e-9481-4139-b6c8-1110064d6ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:39.181357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:39.182369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:39.183322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:39.183322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:39.183322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:39.183322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:39.190889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 436/897] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:39.192566 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73c57e-9481-4139-b6c8-1110064d6ea7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:39.203629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d352da01-c49e-4cd1-8c59-a3656ce9b440 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:39.204866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d352da01-c49e-4cd1-8c59-a3656ce9b440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:39.310209 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:39.311806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 462/898] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:39.333427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73c57e-9481-4139-b6c8-1110064d6ea7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:39.334520 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352da01-c49e-4cd1-8c59-a3656ce9b440 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:39.378866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052aaa-fd2e-4628-a631-da98fdbe1a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:39.379489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052aaa-fd2e-4628-a631-da98fdbe1a97 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.379765 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052aaa-fd2e-4628-a631-da98fdbe1a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.380033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052aaa-fd2e-4628-a631-da98fdbe1a97 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:39.380797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5052aaa-fd2e-4628-a631-da98fdbe1a97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:39.381063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5052aaa-fd2e-4628-a631-da98fdbe1a97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:39.382429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5052aaa-fd2e-4628-a631-da98fdbe1a97 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:39.399162 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 437/899] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:39.401775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052aaa-fd2e-4628-a631-da98fdbe1a97 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:39.442834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:39.454126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352da01-c49e-4cd1-8c59-a3656ce9b440 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:39.494366 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd8192-d939-4dc0-ab20-a91342322a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:39.495419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd8192-d939-4dc0-ab20-a91342322a9b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.495901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd8192-d939-4dc0-ab20-a91342322a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.496466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd8192-d939-4dc0-ab20-a91342322a9b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:39.497402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd8192-d939-4dc0-ab20-a91342322a9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:39.499015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd8192-d939-4dc0-ab20-a91342322a9b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:39.505745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052aaa-fd2e-4628-a631-da98fdbe1a97 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-bdcd8192-d939-4dc0-ab20-a91342322a9b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:39.509770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:39.510756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 01:56:39.511604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:39.514562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 463/900] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Jul 28 01:56:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:39.520319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd8192-d939-4dc0-ab20-a91342322a9b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:39.545653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f35553-59f4-4a1d-bbc1-810da11da41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:39.546783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f35553-59f4-4a1d-bbc1-810da11da41d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.547263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f35553-59f4-4a1d-bbc1-810da11da41d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.547834 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f35553-59f4-4a1d-bbc1-810da11da41d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:39.556062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f35553-59f4-4a1d-bbc1-810da11da41d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:39.557824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f35553-59f4-4a1d-bbc1-810da11da41d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:39.560897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-37f35553-59f4-4a1d-bbc1-810da11da41d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:39.573164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:39.574156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:39.575156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:39.575156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:39.575156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:39.575156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:39.575156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:39.575156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:39.575156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:39.575156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:39.575156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:39.575156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:39.577755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 438/901] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jul 28 01:56:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:39.583290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f35553-59f4-4a1d-bbc1-810da11da41d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:39.630585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd8192-d939-4dc0-ab20-a91342322a9b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:39.667115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8e69e-4d55-4af7-bee7-97fc228b8ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:39.667724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8e69e-4d55-4af7-bee7-97fc228b8ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.668046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8e69e-4d55-4af7-bee7-97fc228b8ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.668382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8e69e-4d55-4af7-bee7-97fc228b8ae9 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:39.668985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8e69e-4d55-4af7-bee7-97fc228b8ae9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:39.669283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8e69e-4d55-4af7-bee7-97fc228b8ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:39.670688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8e69e-4d55-4af7-bee7-97fc228b8ae9 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:39.676099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 464/902] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:39.681974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8e69e-4d55-4af7-bee7-97fc228b8ae9 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:39.699713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:39.729101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f35553-59f4-4a1d-bbc1-810da11da41d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:39.777082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd9283-397d-49ad-87cc-554c74e57065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:39.778078 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd9283-397d-49ad-87cc-554c74e57065 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.778616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd9283-397d-49ad-87cc-554c74e57065 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.779592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd9283-397d-49ad-87cc-554c74e57065 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:39.780884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd9283-397d-49ad-87cc-554c74e57065 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:39.781706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd9283-397d-49ad-87cc-554c74e57065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:39.784123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd9283-397d-49ad-87cc-554c74e57065 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:39.791699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8e69e-4d55-4af7-bee7-97fc228b8ae9 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:39.811788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 439/903] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jul 28 01:56:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:39.817593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd9283-397d-49ad-87cc-554c74e57065 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:39.832793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821ded-5ae1-49ad-b988-a5d1ee6a92ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:39.833949 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821ded-5ae1-49ad-b988-a5d1ee6a92ce None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.834894 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821ded-5ae1-49ad-b988-a5d1ee6a92ce None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.835652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821ded-5ae1-49ad-b988-a5d1ee6a92ce None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:39.836596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47821ded-5ae1-49ad-b988-a5d1ee6a92ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:39.837297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47821ded-5ae1-49ad-b988-a5d1ee6a92ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:39.839279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47821ded-5ae1-49ad-b988-a5d1ee6a92ce None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:39.846749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 465/904] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:39.852333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821ded-5ae1-49ad-b988-a5d1ee6a92ce None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:39.897531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:39.943938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd9283-397d-49ad-87cc-554c74e57065 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:39.948386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:39.975350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821ded-5ae1-49ad-b988-a5d1ee6a92ce None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:39.985073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efd96a-b7c1-4ece-bbe1-04a8ef2ffcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:39.986415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efd96a-b7c1-4ece-bbe1-04a8ef2ffcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:39.987046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efd96a-b7c1-4ece-bbe1-04a8ef2ffcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:39.987540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efd96a-b7c1-4ece-bbe1-04a8ef2ffcc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:40.020737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d0875-e3fd-4e52-8c3d-f6dae0dcadc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:40.021627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0875-e3fd-4e52-8c3d-f6dae0dcadc7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:40.021917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0875-e3fd-4e52-8c3d-f6dae0dcadc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:40.022198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0875-e3fd-4e52-8c3d-f6dae0dcadc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:40.023436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d0875-e3fd-4e52-8c3d-f6dae0dcadc7 None admin] RBAC: Adding query filter params (interface=public, service_id=99477658c8ef4a85972bc53cd58be402, region_id=RegionOne) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:40.023900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d0875-e3fd-4e52-8c3d-f6dae0dcadc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:40.026864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d0875-e3fd-4e52-8c3d-f6dae0dcadc7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:40.038030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 466/905] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jul 28 01:56:39 2022] GET /identity/v3/endpoints?service_id=99477658c8ef4a85972bc53cd58be402&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:40.043273 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d0875-e3fd-4e52-8c3d-f6dae0dcadc7 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:40.078157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efd96a-b7c1-4ece-bbe1-04a8ef2ffcc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:40.079871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efd96a-b7c1-4ece-bbe1-04a8ef2ffcc1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:40.147837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:40.173459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d0875-e3fd-4e52-8c3d-f6dae0dcadc7 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:40.210591 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 440/906] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:39 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 01:56:40.212251 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efd96a-b7c1-4ece-bbe1-04a8ef2ffcc1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:40.212988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8c708-feca-4c65-955e-b38a4f3f450e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:40.213862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8c708-feca-4c65-955e-b38a4f3f450e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:40.214342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8c708-feca-4c65-955e-b38a4f3f450e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:40.214857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8c708-feca-4c65-955e-b38a4f3f450e None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:40.215730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8c708-feca-4c65-955e-b38a4f3f450e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:40.217298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8c708-feca-4c65-955e-b38a4f3f450e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:40.224334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 467/907] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jul 28 01:56:40 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 01:56:40.327042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efd96a-b7c1-4ece-bbe1-04a8ef2ffcc1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:40.375336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96084e2f-bf13-4e84-88f4-96b06ffe039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:40.375929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96084e2f-bf13-4e84-88f4-96b06ffe039c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:40.376196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96084e2f-bf13-4e84-88f4-96b06ffe039c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:40.376466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96084e2f-bf13-4e84-88f4-96b06ffe039c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:40.388773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96084e2f-bf13-4e84-88f4-96b06ffe039c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:40.390318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96084e2f-bf13-4e84-88f4-96b06ffe039c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-96084e2f-bf13-4e84-88f4-96b06ffe039c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:40.406698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:40.407628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:40.408514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:40.408514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:40.408514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:40.408514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:40.412021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 441/908] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:40.413987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8c708-feca-4c65-955e-b38a4f3f450e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:40.428991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:40.528830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8c708-feca-4c65-955e-b38a4f3f450e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:40.563966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426e147-eafe-4795-adb6-4ed6dce97692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:40.564579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426e147-eafe-4795-adb6-4ed6dce97692 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:40.564854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426e147-eafe-4795-adb6-4ed6dce97692 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:40.565173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426e147-eafe-4795-adb6-4ed6dce97692 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:40.565867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426e147-eafe-4795-adb6-4ed6dce97692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:40.566484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426e147-eafe-4795-adb6-4ed6dce97692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:40.567848 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426e147-eafe-4795-adb6-4ed6dce97692 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:40.584283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 468/909] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:40.585649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96084e2f-bf13-4e84-88f4-96b06ffe039c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:40.602849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:40.693376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96084e2f-bf13-4e84-88f4-96b06ffe039c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:40.730641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ebdd9-d505-4983-96ed-2b8c4a7e741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:40.731282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ebdd9-d505-4983-96ed-2b8c4a7e741b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:40.731558 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ebdd9-d505-4983-96ed-2b8c4a7e741b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:40.731828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ebdd9-d505-4983-96ed-2b8c4a7e741b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:40.738983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ebdd9-d505-4983-96ed-2b8c4a7e741b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:40.740431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ebdd9-d505-4983-96ed-2b8c4a7e741b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a91ebdd9-d505-4983-96ed-2b8c4a7e741b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:40.752032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:40.752949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:40.753824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:40.753824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:40.753824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:40.753824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:40.753824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:40.753824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:40.753824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:40.753824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:40.757952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 442/910] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:40.759335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426e147-eafe-4795-adb6-4ed6dce97692 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:40.833351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:40.883888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426e147-eafe-4795-adb6-4ed6dce97692 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:40.920723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfd572-b0de-49aa-9487-3a86615f3d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:40.921711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd572-b0de-49aa-9487-3a86615f3d62 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:40.922194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd572-b0de-49aa-9487-3a86615f3d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:40.922789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd572-b0de-49aa-9487-3a86615f3d62 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:40.923739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfd572-b0de-49aa-9487-3a86615f3d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:40.924244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfd572-b0de-49aa-9487-3a86615f3d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:40.925872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfd572-b0de-49aa-9487-3a86615f3d62 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:40.938622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 469/911] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:40.950528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ebdd9-d505-4983-96ed-2b8c4a7e741b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:40.990670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23795f70-ffe8-45b9-93f6-ce41d0668ad6 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:40.991179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23795f70-ffe8-45b9-93f6-ce41d0668ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:40.991256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23795f70-ffe8-45b9-93f6-ce41d0668ad6 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:40.992973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 470/912] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:40.997960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346ac19-7bb4-445b-b993-603acdd5cef4 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:40.998252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346ac19-7bb4-445b-b993-603acdd5cef4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:40.998555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346ac19-7bb4-445b-b993-603acdd5cef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.019195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-6346ac19-7bb4-445b-b993-603acdd5cef4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:41.019480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:41.021251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6346ac19-7bb4-445b-b993-603acdd5cef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:41.052933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ebdd9-d505-4983-96ed-2b8c4a7e741b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:41.089493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fab62-7fb0-4432-aacb-558adb8f608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:41.090240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fab62-7fb0-4432-aacb-558adb8f608c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:41.090640 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fab62-7fb0-4432-aacb-558adb8f608c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:41.090948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fab62-7fb0-4432-aacb-558adb8f608c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.091800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fab62-7fb0-4432-aacb-558adb8f608c None admin] RBAC: Adding query filter params (role.id=05383c83ec49434b82842b6b3c0c4b38, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=39169d922474437ebb7605d4a34dd7ec) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:41.092176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fab62-7fb0-4432-aacb-558adb8f608c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:41.093887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fab62-7fb0-4432-aacb-558adb8f608c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:41.102820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 471/914] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:41.106097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 443/914] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:40 2022] GET /identity/v3/role_assignments?user.id=39169d922474437ebb7605d4a34dd7ec&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=05383c83ec49434b82842b6b3c0c4b38 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:41.119754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346ac19-7bb4-445b-b993-603acdd5cef4 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:41.184247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:41.232270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346ac19-7bb4-445b-b993-603acdd5cef4 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:41.272516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bcc8e-4172-4d6b-a53f-f5cae3a4ac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:41.273163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bcc8e-4172-4d6b-a53f-f5cae3a4ac7d None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:41.273470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bcc8e-4172-4d6b-a53f-f5cae3a4ac7d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:41.273746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bcc8e-4172-4d6b-a53f-f5cae3a4ac7d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.274384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bcc8e-4172-4d6b-a53f-f5cae3a4ac7d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:41.275792 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bcc8e-4172-4d6b-a53f-f5cae3a4ac7d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-090bcc8e-4172-4d6b-a53f-f5cae3a4ac7d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:41.285646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:41.286684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 01:56:41.287539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:41.288257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aefe1-647c-452a-babe-9a0a59c74c88 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:41.288257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aefe1-647c-452a-babe-9a0a59c74c88 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:41.288257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aefe1-647c-452a-babe-9a0a59c74c88 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.288446 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 472/915] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:56:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:41.288513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 444/916] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:41.292990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bcc8e-4172-4d6b-a53f-f5cae3a4ac7d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:41.294221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaad48-69c8-405b-b2b4-ae77aa6a4ef5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:41.294529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaad48-69c8-405b-b2b4-ae77aa6a4ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:41.294805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaad48-69c8-405b-b2b4-ae77aa6a4ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.318987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-aebaad48-69c8-405b-b2b4-ae77aa6a4ef5 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:41.321393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aebaad48-69c8-405b-b2b4-ae77aa6a4ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:41.404697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bcc8e-4172-4d6b-a53f-f5cae3a4ac7d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:41.411485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 445/917] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:41.429062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:41.434650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaad48-69c8-405b-b2b4-ae77aa6a4ef5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:41.448940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370787d-da57-4846-afd5-ea0bd85d13f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:41.449946 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370787d-da57-4846-afd5-ea0bd85d13f2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:41.450429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370787d-da57-4846-afd5-ea0bd85d13f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:41.450973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370787d-da57-4846-afd5-ea0bd85d13f2 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.451876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370787d-da57-4846-afd5-ea0bd85d13f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:41.452379 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370787d-da57-4846-afd5-ea0bd85d13f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:41.453971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370787d-da57-4846-afd5-ea0bd85d13f2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:41.459538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 473/918] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:56:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:41.464865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370787d-da57-4846-afd5-ea0bd85d13f2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:41.513573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:41.557669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaad48-69c8-405b-b2b4-ae77aa6a4ef5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:41.584472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370787d-da57-4846-afd5-ea0bd85d13f2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:41.597023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1b93f-9c2f-45fe-9f16-9cdc229b5829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:41.597648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1b93f-9c2f-45fe-9f16-9cdc229b5829 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:41.597931 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1b93f-9c2f-45fe-9f16-9cdc229b5829 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:41.598384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1b93f-9c2f-45fe-9f16-9cdc229b5829 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.599061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1b93f-9c2f-45fe-9f16-9cdc229b5829 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:41.600911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1b93f-9c2f-45fe-9f16-9cdc229b5829 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d1d1b93f-9c2f-45fe-9f16-9cdc229b5829 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:41.611176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:41.612390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:41.613369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:41.617877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 446/919] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:41.619331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1b93f-9c2f-45fe-9f16-9cdc229b5829 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:41.626632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26109cf9-d1d8-4a90-b115-1d6560d38970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:41.627433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26109cf9-d1d8-4a90-b115-1d6560d38970 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:41.627859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26109cf9-d1d8-4a90-b115-1d6560d38970 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:41.628280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26109cf9-d1d8-4a90-b115-1d6560d38970 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.629208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26109cf9-d1d8-4a90-b115-1d6560d38970 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:41.629707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26109cf9-d1d8-4a90-b115-1d6560d38970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:41.631403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26109cf9-d1d8-4a90-b115-1d6560d38970 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:41.637814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 474/920] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Jul 28 01:56:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:41.645876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26109cf9-d1d8-4a90-b115-1d6560d38970 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:41.704883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:41.749765 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1b93f-9c2f-45fe-9f16-9cdc229b5829 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:41.760932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26109cf9-d1d8-4a90-b115-1d6560d38970 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:41.785948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:41.797288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e8e68-c2e5-4825-9a16-60d693c669e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:41.797611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004687e8-1d4f-4328-a29f-af3abfd50fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:41.797909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e8e68-c2e5-4825-9a16-60d693c669e7 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:41.798195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e8e68-c2e5-4825-9a16-60d693c669e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:41.798300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004687e8-1d4f-4328-a29f-af3abfd50fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:41.798497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e8e68-c2e5-4825-9a16-60d693c669e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.798614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004687e8-1d4f-4328-a29f-af3abfd50fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:41.798794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004687e8-1d4f-4328-a29f-af3abfd50fc6 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.799213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e8e68-c2e5-4825-9a16-60d693c669e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:41.799461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004687e8-1d4f-4328-a29f-af3abfd50fc6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:41.799766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004687e8-1d4f-4328-a29f-af3abfd50fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:41.800590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e8e68-c2e5-4825-9a16-60d693c669e7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:41.801120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004687e8-1d4f-4328-a29f-af3abfd50fc6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:41.807454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 447/921] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jul 28 01:56:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:41.813121 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004687e8-1d4f-4328-a29f-af3abfd50fc6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:41.826840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 475/922] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 01:56:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:41.942588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004687e8-1d4f-4328-a29f-af3abfd50fc6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:41.989982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5e4df-f9a1-4367-b2f9-9fc42a6fe260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:41.990636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5e4df-f9a1-4367-b2f9-9fc42a6fe260 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:41.990914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5e4df-f9a1-4367-b2f9-9fc42a6fe260 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:41.991181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5e4df-f9a1-4367-b2f9-9fc42a6fe260 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:41.991868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5e4df-f9a1-4367-b2f9-9fc42a6fe260 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:41.992171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5e4df-f9a1-4367-b2f9-9fc42a6fe260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:41.993552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5e4df-f9a1-4367-b2f9-9fc42a6fe260 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:41.999544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 448/923] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jul 28 01:56:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:42.005470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e8e68-c2e5-4825-9a16-60d693c669e7 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:42.115280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e8e68-c2e5-4825-9a16-60d693c669e7 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:42.117740 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:42.151989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594bf94-7d05-42c9-88c5-1d29852c11e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:42.152650 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594bf94-7d05-42c9-88c5-1d29852c11e0 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:42.152929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594bf94-7d05-42c9-88c5-1d29852c11e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:42.153197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594bf94-7d05-42c9-88c5-1d29852c11e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:42.153957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594bf94-7d05-42c9-88c5-1d29852c11e0 None admin] RBAC: Adding query filter params (interface=public, service_id=f4ea98e96112454c8657d987a55d054e, region_id=RegionOne) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:42.154261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594bf94-7d05-42c9-88c5-1d29852c11e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:42.155656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594bf94-7d05-42c9-88c5-1d29852c11e0 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:42.161153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 476/924] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jul 28 01:56:42 2022] GET /identity/v3/endpoints?service_id=f4ea98e96112454c8657d987a55d054e&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:42.167328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5e4df-f9a1-4367-b2f9-9fc42a6fe260 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:42.222592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:42.275410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5e4df-f9a1-4367-b2f9-9fc42a6fe260 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:42.310404 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2a868-a078-4651-9643-44c7035b986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:42.311099 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2a868-a078-4651-9643-44c7035b986f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:42.311381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2a868-a078-4651-9643-44c7035b986f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:42.311650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2a868-a078-4651-9643-44c7035b986f None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:42.312302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2a868-a078-4651-9643-44c7035b986f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:42.313653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2a868-a078-4651-9643-44c7035b986f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:42.320970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 449/925] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jul 28 01:56:42 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 01:56:42.488609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c418-2e73-4c83-ad98-6febc9da2f8f None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:42.489271 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c418-2e73-4c83-ad98-6febc9da2f8f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:42.489777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c418-2e73-4c83-ad98-6febc9da2f8f None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:42.491625 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 477/926] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:42.497146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81292-3d20-44b9-8abe-964daf4a600c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:42.497717 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81292-3d20-44b9-8abe-964daf4a600c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:42.498202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81292-3d20-44b9-8abe-964daf4a600c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:42.517529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-34d81292-3d20-44b9-8abe-964daf4a600c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:42.518912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-34d81292-3d20-44b9-8abe-964daf4a600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:42.589854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 450/927] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:42.611828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c418-2e73-4c83-ad98-6febc9da2f8f None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:42.725381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c418-2e73-4c83-ad98-6febc9da2f8f None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:42.760872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039961cb-2983-4fb5-b56b-d1e9cfbc37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:42.761424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039961cb-2983-4fb5-b56b-d1e9cfbc37a0 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:42.761701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039961cb-2983-4fb5-b56b-d1e9cfbc37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:42.761972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039961cb-2983-4fb5-b56b-d1e9cfbc37a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:42.762677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039961cb-2983-4fb5-b56b-d1e9cfbc37a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:42.764054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039961cb-2983-4fb5-b56b-d1e9cfbc37a0 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-039961cb-2983-4fb5-b56b-d1e9cfbc37a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:42.773450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:42.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:42.775463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 478/928] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Jul 28 01:56:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:42.781193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d81292-3d20-44b9-8abe-964daf4a600c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:42.830838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:42.885076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d81292-3d20-44b9-8abe-964daf4a600c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:42.919585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7490114-d64b-4235-b27d-b0ea0afb0308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:42.920205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7490114-d64b-4235-b27d-b0ea0afb0308 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:42.920482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7490114-d64b-4235-b27d-b0ea0afb0308 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:42.920751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7490114-d64b-4235-b27d-b0ea0afb0308 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:42.921419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7490114-d64b-4235-b27d-b0ea0afb0308 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:42.921720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7490114-d64b-4235-b27d-b0ea0afb0308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:42.923109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7490114-d64b-4235-b27d-b0ea0afb0308 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:42.928352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 451/929] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:42.934648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039961cb-2983-4fb5-b56b-d1e9cfbc37a0 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:42.974815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:43.044549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039961cb-2983-4fb5-b56b-d1e9cfbc37a0 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:43.083417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb1d07-7bba-4252-a24c-f41e11365e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:43.084081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1d07-7bba-4252-a24c-f41e11365e39 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:43.084365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1d07-7bba-4252-a24c-f41e11365e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:43.084638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1d07-7bba-4252-a24c-f41e11365e39 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:43.085325 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb1d07-7bba-4252-a24c-f41e11365e39 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:43.085627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb1d07-7bba-4252-a24c-f41e11365e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:43.087075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb1d07-7bba-4252-a24c-f41e11365e39 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:43.092415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 479/930] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:43.097949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7490114-d64b-4235-b27d-b0ea0afb0308 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:43.201859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe95137-2c5e-465b-9bef-ff7887187644 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:43.202547 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe95137-2c5e-465b-9bef-ff7887187644 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:43.202751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7490114-d64b-4235-b27d-b0ea0afb0308 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:43.203568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe95137-2c5e-465b-9bef-ff7887187644 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:43.206317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 480/931] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:43.210522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09289be2-6366-4642-9736-4473a6cd3970 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:43.211060 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09289be2-6366-4642-9736-4473a6cd3970 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:43.211570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09289be2-6366-4642-9736-4473a6cd3970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:43.214825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:43.235238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-09289be2-6366-4642-9736-4473a6cd3970 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:43.236839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-09289be2-6366-4642-9736-4473a6cd3970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:43.241375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cb241-a1a1-4761-aee9-48a1435e7cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:43.241992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cb241-a1a1-4761-aee9-48a1435e7cc6 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:43.242904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cb241-a1a1-4761-aee9-48a1435e7cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:43.243177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cb241-a1a1-4761-aee9-48a1435e7cc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:43.243891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cb241-a1a1-4761-aee9-48a1435e7cc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:43.245240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cb241-a1a1-4761-aee9-48a1435e7cc6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:43.273942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 452/932] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 01:56:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:43.337838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 481/933] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:43.362837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cb241-a1a1-4761-aee9-48a1435e7cc6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:43.483155 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cb241-a1a1-4761-aee9-48a1435e7cc6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:43.519950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65738e82-fa72-4568-8474-72bfe824742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:43.520975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65738e82-fa72-4568-8474-72bfe824742a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:43.521473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65738e82-fa72-4568-8474-72bfe824742a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:43.521970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65738e82-fa72-4568-8474-72bfe824742a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:43.533964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65738e82-fa72-4568-8474-72bfe824742a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-65738e82-fa72-4568-8474-72bfe824742a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:43.540315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:43.541254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:56:43.542089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:43.549449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 453/934] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jul 28 01:56:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:43.551131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09289be2-6366-4642-9736-4473a6cd3970 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:43.577123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:43.661459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09289be2-6366-4642-9736-4473a6cd3970 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:43.698716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78ddfe-5316-4771-9c91-025e32f1c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:43.699701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78ddfe-5316-4771-9c91-025e32f1c348 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:43.700207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78ddfe-5316-4771-9c91-025e32f1c348 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:43.700713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78ddfe-5316-4771-9c91-025e32f1c348 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:43.701646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78ddfe-5316-4771-9c91-025e32f1c348 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:43.702174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78ddfe-5316-4771-9c91-025e32f1c348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:43.703783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78ddfe-5316-4771-9c91-025e32f1c348 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:43.717486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 482/935] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jul 28 01:56:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:43.719090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65738e82-fa72-4568-8474-72bfe824742a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:43.749164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:43.827869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65738e82-fa72-4568-8474-72bfe824742a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:43.863846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea8915-eaa0-4436-809c-ad4e861b5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:43.864894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8915-eaa0-4436-809c-ad4e861b5298 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:43.865380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8915-eaa0-4436-809c-ad4e861b5298 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:43.865865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8915-eaa0-4436-809c-ad4e861b5298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:43.877258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea8915-eaa0-4436-809c-ad4e861b5298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:43.879061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea8915-eaa0-4436-809c-ad4e861b5298 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7fea8915-eaa0-4436-809c-ad4e861b5298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:43.895542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:43.896458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:43.897431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:43.897431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:43.897431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:43.897431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:43.901950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 454/936] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:43.903372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78ddfe-5316-4771-9c91-025e32f1c348 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:43.983081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10553c3d-71c3-402a-8b1f-a1d41eb4878a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:43.983280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10553c3d-71c3-402a-8b1f-a1d41eb4878a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:43.983812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10553c3d-71c3-402a-8b1f-a1d41eb4878a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:43.985631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 455/937] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:43.991154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6a498-b977-4f3d-a836-a625633b7fff None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:43.992248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6a498-b977-4f3d-a836-a625633b7fff None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:43.992825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6a498-b977-4f3d-a836-a625633b7fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:43.999659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:44.019151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78ddfe-5316-4771-9c91-025e32f1c348 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:44.020353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a5a6a498-b977-4f3d-a836-a625633b7fff None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:44.022900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a5a6a498-b977-4f3d-a836-a625633b7fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:44.059888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0de579-f150-48a6-aa20-c7cc934f3bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:44.061910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0de579-f150-48a6-aa20-c7cc934f3bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.062536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0de579-f150-48a6-aa20-c7cc934f3bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.063080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0de579-f150-48a6-aa20-c7cc934f3bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.064057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0de579-f150-48a6-aa20-c7cc934f3bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:44.064942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0de579-f150-48a6-aa20-c7cc934f3bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:44.067083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0de579-f150-48a6-aa20-c7cc934f3bb4 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:44.083346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 483/938] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:44.089065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0de579-f150-48a6-aa20-c7cc934f3bb4 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:44.126461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 456/939] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:44.144940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6a498-b977-4f3d-a836-a625633b7fff None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:44.158236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:44.208140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0de579-f150-48a6-aa20-c7cc934f3bb4 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:44.250248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56bcc-7131-46a1-90e9-7090c59a853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:44.251899 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56bcc-7131-46a1-90e9-7090c59a853f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.252545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56bcc-7131-46a1-90e9-7090c59a853f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.253057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56bcc-7131-46a1-90e9-7090c59a853f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.263850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a56bcc-7131-46a1-90e9-7090c59a853f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:44.265710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a56bcc-7131-46a1-90e9-7090c59a853f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:44.276462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6a498-b977-4f3d-a836-a625633b7fff None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-61a56bcc-7131-46a1-90e9-7090c59a853f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:44.280051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:44.280966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:44.281950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:44.281950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:44.281950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:44.281950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:44.281950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:44.281950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:44.281950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:44.281950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:44.281950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:44.281950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:44.284549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 484/940] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jul 28 01:56:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:44.293399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56bcc-7131-46a1-90e9-7090c59a853f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:44.294000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:44.314898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:44.315526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.315805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.316734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.317033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:44.318488 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:44.321659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WARNING keystone.server.flask.common [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 01:56:44.339072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.sql.core [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 01:56:44.339072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 01:56:44.339072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [parameters: {'id': 'a708f2748de94720ad9a273632a44322', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 01:56:44.339072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a708f2748de94720ad9a273632a44322.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a708f2748de94720ad9a273632a44322. Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 01:56:44.356643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 01:56:44.357690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application yield resource Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise self.value Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application session.commit() Jul 28 01:56:44.358874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.flush() Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application compat.raise_( Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 01:56:44.359789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 01:56:44.360671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 01:56:44.361465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [parameters: {'id': 'a708f2748de94720ad9a273632a44322', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:44.362332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:44.365380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:44.368144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:44.368144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 01:56:44.368144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 01:56:44.368144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:44.368144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:44.368144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 01:56:44.368144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 01:56:44.368144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a708f2748de94720ad9a273632a44322. Jul 28 01:56:44.368144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.368144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 457/941] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Jul 28 01:56:44 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:44.371439 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:44.414070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56bcc-7131-46a1-90e9-7090c59a853f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:44.444767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:44.451769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3dfd02-c744-4b43-8d64-bc08941edc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:44.452445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dfd02-c744-4b43-8d64-bc08941edc90 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.452722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dfd02-c744-4b43-8d64-bc08941edc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.453141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dfd02-c744-4b43-8d64-bc08941edc90 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.454687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3dfd02-c744-4b43-8d64-bc08941edc90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:44.455104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3dfd02-c744-4b43-8d64-bc08941edc90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:44.456608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3dfd02-c744-4b43-8d64-bc08941edc90 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:44.475578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 485/942] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jul 28 01:56:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:44.476816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a9441-6bf0-427e-b975-1aec8b1ef155 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.477100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a9441-6bf0-427e-b975-1aec8b1ef155 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.477370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a9441-6bf0-427e-b975-1aec8b1ef155 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.478711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 486/943] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:44.484278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8440835-b53b-4ef0-8159-bbe66965c800 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.484556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8440835-b53b-4ef0-8159-bbe66965c800 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.484828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8440835-b53b-4ef0-8159-bbe66965c800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.496489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d2590-9405-49a0-9584-e9b66f9b558f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:44.509683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d8440835-b53b-4ef0-8159-bbe66965c800 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:44.510850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d8440835-b53b-4ef0-8159-bbe66965c800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:44.534015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd89833-5405-44f7-a774-bef53fe6771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:44.534702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89833-5405-44f7-a774-bef53fe6771b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.534980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89833-5405-44f7-a774-bef53fe6771b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.535270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89833-5405-44f7-a774-bef53fe6771b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.542055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd89833-5405-44f7-a774-bef53fe6771b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:44.543793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd89833-5405-44f7-a774-bef53fe6771b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0fd89833-5405-44f7-a774-bef53fe6771b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:44.555752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:44.556664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:44.557554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:44.557554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:44.557554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:44.557554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:44.557554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:44.557554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:44.557554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:44.557554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.557554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 458/944] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:44.558913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd89833-5405-44f7-a774-bef53fe6771b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:44.574611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:44.586262 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 487/945] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:44.590610 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8440835-b53b-4ef0-8159-bbe66965c800 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:44.672433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd89833-5405-44f7-a774-bef53fe6771b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:44.697122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:44.702117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8440835-b53b-4ef0-8159-bbe66965c800 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:44.710459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75a6a5-e41d-4702-89cf-da88f5eac437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:44.711098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75a6a5-e41d-4702-89cf-da88f5eac437 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.711726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75a6a5-e41d-4702-89cf-da88f5eac437 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.711998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75a6a5-e41d-4702-89cf-da88f5eac437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.723123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75a6a5-e41d-4702-89cf-da88f5eac437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:44.724553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75a6a5-e41d-4702-89cf-da88f5eac437 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:44.737280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76817ecc-7bf3-44d7-8246-548919a2bdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:44.737900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76817ecc-7bf3-44d7-8246-548919a2bdba None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.738193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76817ecc-7bf3-44d7-8246-548919a2bdba None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.738477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76817ecc-7bf3-44d7-8246-548919a2bdba None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.739211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76817ecc-7bf3-44d7-8246-548919a2bdba None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8f75a6a5-e41d-4702-89cf-da88f5eac437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:44.739370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:44.740215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:44.741130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:44.741130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:44.741130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:44.741130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.741347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76817ecc-7bf3-44d7-8246-548919a2bdba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:44.741430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 459/946] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:44.741894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75a6a5-e41d-4702-89cf-da88f5eac437 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:44.746570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76817ecc-7bf3-44d7-8246-548919a2bdba None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:44.763838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 488/947] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:44.775543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76817ecc-7bf3-44d7-8246-548919a2bdba None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:44.849630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:44.870092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75a6a5-e41d-4702-89cf-da88f5eac437 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:44.907116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76817ecc-7bf3-44d7-8246-548919a2bdba None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:44.923157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c8bbf-b49d-47be-ac2a-9f25e786de17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:44.923803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c8bbf-b49d-47be-ac2a-9f25e786de17 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.924082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c8bbf-b49d-47be-ac2a-9f25e786de17 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.924355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c8bbf-b49d-47be-ac2a-9f25e786de17 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.924998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c8bbf-b49d-47be-ac2a-9f25e786de17 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:44.926364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c8bbf-b49d-47be-ac2a-9f25e786de17 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-831c8bbf-b49d-47be-ac2a-9f25e786de17 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:44.937954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:44.939063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:44.939895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:44.946176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 460/948] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:44.946587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c8bbf-b49d-47be-ac2a-9f25e786de17 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:44.951344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e86ba-6002-4623-9917-aaaf6623890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:44.952167 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e86ba-6002-4623-9917-aaaf6623890d None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:44.952588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e86ba-6002-4623-9917-aaaf6623890d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:44.953001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e86ba-6002-4623-9917-aaaf6623890d None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:44.954694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e86ba-6002-4623-9917-aaaf6623890d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:44.954908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e86ba-6002-4623-9917-aaaf6623890d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:44.956333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e86ba-6002-4623-9917-aaaf6623890d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:44.974381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 489/949] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:44.976140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e86ba-6002-4623-9917-aaaf6623890d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:44.994022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:45.065253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c8bbf-b49d-47be-ac2a-9f25e786de17 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:45.105400 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e86ba-6002-4623-9917-aaaf6623890d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:45.109361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3de03-2aa4-4b45-989c-600cbdb341fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:45.109983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3de03-2aa4-4b45-989c-600cbdb341fa None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:45.110259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3de03-2aa4-4b45-989c-600cbdb341fa None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:45.110574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3de03-2aa4-4b45-989c-600cbdb341fa None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:45.111255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3de03-2aa4-4b45-989c-600cbdb341fa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:45.111557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3de03-2aa4-4b45-989c-600cbdb341fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:45.112923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3de03-2aa4-4b45-989c-600cbdb341fa None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:45.128036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:45.128244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 461/950] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jul 28 01:56:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:45.129128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3de03-2aa4-4b45-989c-600cbdb341fa None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:45.156030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cac3a-fbe9-47ac-bdb2-7386b4e8358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:45.156666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cac3a-fbe9-47ac-bdb2-7386b4e8358e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:45.156940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cac3a-fbe9-47ac-bdb2-7386b4e8358e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:45.157206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cac3a-fbe9-47ac-bdb2-7386b4e8358e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:45.164330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cac3a-fbe9-47ac-bdb2-7386b4e8358e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:45.165774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cac3a-fbe9-47ac-bdb2-7386b4e8358e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-f90cac3a-fbe9-47ac-bdb2-7386b4e8358e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:45.177149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:45.178079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:45.179013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:45.179013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:45.179013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:45.179013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:45.179013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:45.179013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:45.179013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:45.179013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:45.183933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 490/951] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:45.184880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cac3a-fbe9-47ac-bdb2-7386b4e8358e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:45.247594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3de03-2aa4-4b45-989c-600cbdb341fa None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:45.250350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:45.285340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbb52a-7ad0-4bae-8368-dfa0b264b7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:45.287197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb52a-7ad0-4bae-8368-dfa0b264b7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:45.287956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb52a-7ad0-4bae-8368-dfa0b264b7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:45.288434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb52a-7ad0-4bae-8368-dfa0b264b7f3 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:45.289392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbb52a-7ad0-4bae-8368-dfa0b264b7f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:45.289846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cac3a-fbe9-47ac-bdb2-7386b4e8358e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:45.290106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbb52a-7ad0-4bae-8368-dfa0b264b7f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:45.291986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbb52a-7ad0-4bae-8368-dfa0b264b7f3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:45.303858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 462/952] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jul 28 01:56:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:45.306694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbb52a-7ad0-4bae-8368-dfa0b264b7f3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:45.330382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d13a5-bf65-4dc5-b77d-c13f9ccc4c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:45.330984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d13a5-bf65-4dc5-b77d-c13f9ccc4c1a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:45.331244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d13a5-bf65-4dc5-b77d-c13f9ccc4c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:45.331514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d13a5-bf65-4dc5-b77d-c13f9ccc4c1a None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:45.332350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d13a5-bf65-4dc5-b77d-c13f9ccc4c1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:45.332556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d13a5-bf65-4dc5-b77d-c13f9ccc4c1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:45.333998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d13a5-bf65-4dc5-b77d-c13f9ccc4c1a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:45.350539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 491/953] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:45.355190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d13a5-bf65-4dc5-b77d-c13f9ccc4c1a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:45.390062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:45.430617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbb52a-7ad0-4bae-8368-dfa0b264b7f3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:45.466816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d13a5-bf65-4dc5-b77d-c13f9ccc4c1a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:45.468713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d9046-e471-47be-a412-b032cdd52eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:45.469333 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d9046-e471-47be-a412-b032cdd52eb9 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:45.469607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d9046-e471-47be-a412-b032cdd52eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:45.469881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d9046-e471-47be-a412-b032cdd52eb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:45.470614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d9046-e471-47be-a412-b032cdd52eb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:45.471976 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d9046-e471-47be-a412-b032cdd52eb9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:45.496060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 463/954] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 01:56:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 01:56:45.497711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf135bf6-bf79-4b0e-a3e7-1e70aff8f051 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:45.498065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf135bf6-bf79-4b0e-a3e7-1e70aff8f051 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:45.498429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf135bf6-bf79-4b0e-a3e7-1e70aff8f051 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:45.499999 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 464/955] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:45.505454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578f06-9680-4339-ad12-3d413a04d5c7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:45.505918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578f06-9680-4339-ad12-3d413a04d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:45.506200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578f06-9680-4339-ad12-3d413a04d5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:45.528630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5f578f06-9680-4339-ad12-3d413a04d5c7 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:45.529683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760affe-f73a-40f6-93ac-1171560988b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:45.530466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760affe-f73a-40f6-93ac-1171560988b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:45.530819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760affe-f73a-40f6-93ac-1171560988b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:45.531186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760affe-f73a-40f6-93ac-1171560988b1 None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/39169d922474437ebb7605d4a34dd7ec/roles/05383c83ec49434b82842b6b3c0c4b38` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:45.531496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5f578f06-9680-4339-ad12-3d413a04d5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:45.533716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760affe-f73a-40f6-93ac-1171560988b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=39169d922474437ebb7605d4a34dd7ec, role_id=05383c83ec49434b82842b6b3c0c4b38)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:45.536525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760affe-f73a-40f6-93ac-1171560988b1 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:45.557887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:45.558636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 492/956] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:56:45 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/39169d922474437ebb7605d4a34dd7ec/roles/05383c83ec49434b82842b6b3c0c4b38 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 01:56:45.630175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 465/957] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:45.652034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760affe-f73a-40f6-93ac-1171560988b1 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:45.755707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:45.768736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760affe-f73a-40f6-93ac-1171560988b1 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:45.805173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141eb60-05cf-4a83-96a6-c92145b86fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:45.805820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141eb60-05cf-4a83-96a6-c92145b86fbc None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:45.806099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141eb60-05cf-4a83-96a6-c92145b86fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:45.806371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141eb60-05cf-4a83-96a6-c92145b86fbc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:45.807042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141eb60-05cf-4a83-96a6-c92145b86fbc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:45.808774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141eb60-05cf-4a83-96a6-c92145b86fbc None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-1141eb60-05cf-4a83-96a6-c92145b86fbc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:45.818152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:45.819289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:45.820217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 493/958] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:45.827688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f578f06-9680-4339-ad12-3d413a04d5c7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:45.945722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f578f06-9680-4339-ad12-3d413a04d5c7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:45.981579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b519e5-f09b-4124-a8d3-01be4a53270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:45.982205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b519e5-f09b-4124-a8d3-01be4a53270e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:45.982505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b519e5-f09b-4124-a8d3-01be4a53270e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:45.982779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b519e5-f09b-4124-a8d3-01be4a53270e None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:45.983461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b519e5-f09b-4124-a8d3-01be4a53270e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:45.983761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b519e5-f09b-4124-a8d3-01be4a53270e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:45.985133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b519e5-f09b-4124-a8d3-01be4a53270e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:45.990334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 466/959] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:45.996207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141eb60-05cf-4a83-96a6-c92145b86fbc None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:46.113569 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141eb60-05cf-4a83-96a6-c92145b86fbc None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:46.149086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b98b76-2c32-44e2-a966-cf8d9c27378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:46.149633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b98b76-2c32-44e2-a966-cf8d9c27378f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:46.149914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b98b76-2c32-44e2-a966-cf8d9c27378f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:46.150187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b98b76-2c32-44e2-a966-cf8d9c27378f None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:46.150898 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b98b76-2c32-44e2-a966-cf8d9c27378f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:46.151205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b98b76-2c32-44e2-a966-cf8d9c27378f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:46.152579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b98b76-2c32-44e2-a966-cf8d9c27378f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:46.157516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 494/960] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:46.936017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfab76-8b01-443f-ba6f-9700448a84cd None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:46.936518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfab76-8b01-443f-ba6f-9700448a84cd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:46.936596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfab76-8b01-443f-ba6f-9700448a84cd None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:46.938045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 467/961] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:46.943611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b933-f750-4f0c-80cd-790d708630e9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:46.944112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b933-f750-4f0c-80cd-790d708630e9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:46.944607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b933-f750-4f0c-80cd-790d708630e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:46.964083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-fe72b933-f750-4f0c-80cd-790d708630e9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:46.965613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fe72b933-f750-4f0c-80cd-790d708630e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:46.979176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:47.036618 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 495/962] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:47.061544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfab76-8b01-443f-ba6f-9700448a84cd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:47.081498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:47.168598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfab76-8b01-443f-ba6f-9700448a84cd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:47.204308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1290f-064e-4ab0-addc-91bde5107f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:47.204930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1290f-064e-4ab0-addc-91bde5107f43 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:47.205211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1290f-064e-4ab0-addc-91bde5107f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:47.205482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1290f-064e-4ab0-addc-91bde5107f43 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:47.206167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1290f-064e-4ab0-addc-91bde5107f43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:47.207638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1290f-064e-4ab0-addc-91bde5107f43 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:47.225086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.sql.core [None req-cde1290f-064e-4ab0-addc-91bde5107f43 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 01:56:47.225086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 01:56:47.225086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [parameters: {'user_id': '89069200b0a945a583651bc30f3dd7f0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 01:56:47.225086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-cde1290f-064e-4ab0-addc-91bde5107f43 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jul 28 01:56:47.233005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 01:56:47.233896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application yield resource Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise self.value Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application session.commit() Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 01:56:47.234892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.flush() Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application compat.raise_( Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 01:56:47.235816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 01:56:47.236692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 01:56:47.237537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [parameters: {'user_id': '89069200b0a945a583651bc30f3dd7f0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:47.238368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 01:56:47.241240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 01:56:47.244225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 01:56:47.244225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 01:56:47.244225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 01:56:47.244225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 01:56:47.244225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 01:56:47.244225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:47.244225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 468/963] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Jul 28 01:56:47 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:47.245135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72b933-f750-4f0c-80cd-790d708630e9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:47.351340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72b933-f750-4f0c-80cd-790d708630e9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:47.387361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ed0a-2f79-4050-b2f2-4328746f96e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:47.388007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ed0a-2f79-4050-b2f2-4328746f96e8 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:47.388287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ed0a-2f79-4050-b2f2-4328746f96e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:47.388563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ed0a-2f79-4050-b2f2-4328746f96e8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:47.395921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98ed0a-2f79-4050-b2f2-4328746f96e8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:47.397378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98ed0a-2f79-4050-b2f2-4328746f96e8 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-5d98ed0a-2f79-4050-b2f2-4328746f96e8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:47.409896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:47.410919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:47.411846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 496/964] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:47.417609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1290f-064e-4ab0-addc-91bde5107f43 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:47.502567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:47.524040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1290f-064e-4ab0-addc-91bde5107f43 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:47.561826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5d62a-8484-4add-980f-658f9fe0c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:47.562468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5d62a-8484-4add-980f-658f9fe0c9dd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:47.562800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5d62a-8484-4add-980f-658f9fe0c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:47.563080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5d62a-8484-4add-980f-658f9fe0c9dd None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:47.563851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5d62a-8484-4add-980f-658f9fe0c9dd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:47.564156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5d62a-8484-4add-980f-658f9fe0c9dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:47.565804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5d62a-8484-4add-980f-658f9fe0c9dd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:47.605599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 469/965] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Jul 28 01:56:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:47.656560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5996-ce06-462d-a8dc-5d9efb02ea8d None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:47.656911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5996-ce06-462d-a8dc-5d9efb02ea8d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:47.657107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5996-ce06-462d-a8dc-5d9efb02ea8d None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:47.659024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 497/966] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:47.661614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e3ce-1721-455e-9e86-6df9a86552c0 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:47.661909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e3ce-1721-455e-9e86-6df9a86552c0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:47.662193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e3ce-1721-455e-9e86-6df9a86552c0 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:47.663775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 470/967] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:47.665907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011d467-0669-48dc-b38d-38ffd7a9bfe1 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:47.666238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011d467-0669-48dc-b38d-38ffd7a9bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:47.666494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011d467-0669-48dc-b38d-38ffd7a9bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:47.671111 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94930d9c-6a7c-4285-a352-d76ca7bb521e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:47.671836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94930d9c-6a7c-4285-a352-d76ca7bb521e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:47.672313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94930d9c-6a7c-4285-a352-d76ca7bb521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:47.680419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:47.687900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4011d467-0669-48dc-b38d-38ffd7a9bfe1 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:47.689127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4011d467-0669-48dc-b38d-38ffd7a9bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:47.692907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-94930d9c-6a7c-4285-a352-d76ca7bb521e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:47.694759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-94930d9c-6a7c-4285-a352-d76ca7bb521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:47.774277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 498/969] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:47.774706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 471/969] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:47.789000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011d467-0669-48dc-b38d-38ffd7a9bfe1 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:47.794030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94930d9c-6a7c-4285-a352-d76ca7bb521e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:47.878806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:47.917380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94930d9c-6a7c-4285-a352-d76ca7bb521e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:47.917967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011d467-0669-48dc-b38d-38ffd7a9bfe1 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:47.952748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285bdb6-b387-424f-ae34-0ad4e25d4456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:47.953479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285bdb6-b387-424f-ae34-0ad4e25d4456 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:47.953667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285bdb6-b387-424f-ae34-0ad4e25d4456 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:47.953943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285bdb6-b387-424f-ae34-0ad4e25d4456 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:47.958177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3271cf-8cfc-4687-96a2-57b7f5bf155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:47.959066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3271cf-8cfc-4687-96a2-57b7f5bf155c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:47.959527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3271cf-8cfc-4687-96a2-57b7f5bf155c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:47.959976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3271cf-8cfc-4687-96a2-57b7f5bf155c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:47.960952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3271cf-8cfc-4687-96a2-57b7f5bf155c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:47.962641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3271cf-8cfc-4687-96a2-57b7f5bf155c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:47.964976 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285bdb6-b387-424f-ae34-0ad4e25d4456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:47.965679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5285bdb6-b387-424f-ae34-0ad4e25d4456 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:47.969987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:47.971144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:47.977337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 472/970] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jul 28 01:56:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-ca3271cf-8cfc-4687-96a2-57b7f5bf155c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:47.978197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:47.979445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:47.981584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 499/971] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:47.983476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285bdb6-b387-424f-ae34-0ad4e25d4456 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:47.983572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3271cf-8cfc-4687-96a2-57b7f5bf155c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:48.089716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3271cf-8cfc-4687-96a2-57b7f5bf155c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:48.096022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285bdb6-b387-424f-ae34-0ad4e25d4456 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:48.125091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:48.131101 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0c16-0b5f-4331-8e4e-9e3429feb03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:48.131801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0c16-0b5f-4331-8e4e-9e3429feb03e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.132169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0c16-0b5f-4331-8e4e-9e3429feb03e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.132509 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0c16-0b5f-4331-8e4e-9e3429feb03e None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.133862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0c16-0b5f-4331-8e4e-9e3429feb03e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:48.134234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0c16-0b5f-4331-8e4e-9e3429feb03e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:48.134466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de780e-fa02-4560-ad07-924a16ed3db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:48.135093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de780e-fa02-4560-ad07-924a16ed3db4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.135369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de780e-fa02-4560-ad07-924a16ed3db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.135640 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de780e-fa02-4560-ad07-924a16ed3db4 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.135737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0c16-0b5f-4331-8e4e-9e3429feb03e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:48.136351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de780e-fa02-4560-ad07-924a16ed3db4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:48.136654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de780e-fa02-4560-ad07-924a16ed3db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:48.138006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de780e-fa02-4560-ad07-924a16ed3db4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:48.140806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 500/972] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jul 28 01:56:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:48.146161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0c16-0b5f-4331-8e4e-9e3429feb03e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:48.151611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 473/973] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jul 28 01:56:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:48.152479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de780e-fa02-4560-ad07-924a16ed3db4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:48.211224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:48.249527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0c16-0b5f-4331-8e4e-9e3429feb03e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:48.254626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de780e-fa02-4560-ad07-924a16ed3db4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:48.282381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d64d35-ac53-4bbc-9292-8a5ff5d6cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:48.283031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d64d35-ac53-4bbc-9292-8a5ff5d6cf8c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.283312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d64d35-ac53-4bbc-9292-8a5ff5d6cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.283585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d64d35-ac53-4bbc-9292-8a5ff5d6cf8c None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.284265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d64d35-ac53-4bbc-9292-8a5ff5d6cf8c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:48.284570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d64d35-ac53-4bbc-9292-8a5ff5d6cf8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:48.285932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d64d35-ac53-4bbc-9292-8a5ff5d6cf8c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:48.287743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ed2cf-5018-42b3-a07e-e833a49dd7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:48.288374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed2cf-5018-42b3-a07e-e833a49dd7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.288654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed2cf-5018-42b3-a07e-e833a49dd7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.288955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed2cf-5018-42b3-a07e-e833a49dd7a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.290863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 501/974] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jul 28 01:56:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:48.292000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955de9-2102-4eb8-a9e7-78b57882525f None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.292278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955de9-2102-4eb8-a9e7-78b57882525f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.292547 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955de9-2102-4eb8-a9e7-78b57882525f None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.293933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 502/975] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:48.298383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955de9-2102-4eb8-a9e7-78b57882525f None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:48.301041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ed2cf-5018-42b3-a07e-e833a49dd7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:48.302510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ed2cf-5018-42b3-a07e-e833a49dd7a5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6e5ed2cf-5018-42b3-a07e-e833a49dd7a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:48.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:48.318696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:48.319619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:48.319619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:48.319619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:48.319619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:48.319619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 474/976] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:48.320875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d7e33-edc1-47fa-a2aa-30d9bf84f2dd None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.320875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d7e33-edc1-47fa-a2aa-30d9bf84f2dd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.321128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d7e33-edc1-47fa-a2aa-30d9bf84f2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.338163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-da0d7e33-edc1-47fa-a2aa-30d9bf84f2dd None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:48.339389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-da0d7e33-edc1-47fa-a2aa-30d9bf84f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:48.374232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:48.403160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955de9-2102-4eb8-a9e7-78b57882525f None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:48.405328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 475/977] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:48.406059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d7e33-edc1-47fa-a2aa-30d9bf84f2dd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:48.432459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:48.440442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bbb70-4685-470c-aa1f-c90ecc6481b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:48.441055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bbb70-4685-470c-aa1f-c90ecc6481b6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.441595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bbb70-4685-470c-aa1f-c90ecc6481b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.441868 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bbb70-4685-470c-aa1f-c90ecc6481b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.442656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bbb70-4685-470c-aa1f-c90ecc6481b6 None admin] RBAC: Adding query filter params (interface=admin, service_id=f4ea98e96112454c8657d987a55d054e, region_id=RegionOne) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:48.442969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bbb70-4685-470c-aa1f-c90ecc6481b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:48.444328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bbb70-4685-470c-aa1f-c90ecc6481b6 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:48.453790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 503/978] 10.222.0.36 () {56 vars in 1249 bytes} [Thu Jul 28 01:56:48 2022] GET /identity/v3/endpoints?service_id=f4ea98e96112454c8657d987a55d054e&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:48.453790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bbb70-4685-470c-aa1f-c90ecc6481b6 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:48.506972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d7e33-edc1-47fa-a2aa-30d9bf84f2dd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:48.540664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf59668-6668-4ab9-8fbb-7f0d875161ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:48.541270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf59668-6668-4ab9-8fbb-7f0d875161ed None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.541543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf59668-6668-4ab9-8fbb-7f0d875161ed None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.541808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf59668-6668-4ab9-8fbb-7f0d875161ed None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.542531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf59668-6668-4ab9-8fbb-7f0d875161ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:48.542832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf59668-6668-4ab9-8fbb-7f0d875161ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:48.544186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf59668-6668-4ab9-8fbb-7f0d875161ed None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:48.547832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bbb70-4685-470c-aa1f-c90ecc6481b6 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:48.555733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 476/979] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:48.556573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf59668-6668-4ab9-8fbb-7f0d875161ed None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:48.585797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31106627-2c71-468e-9a18-9529cab0ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:48.586409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106627-2c71-468e-9a18-9529cab0ac41 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.586729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106627-2c71-468e-9a18-9529cab0ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.587001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106627-2c71-468e-9a18-9529cab0ac41 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.587202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:48.587687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31106627-2c71-468e-9a18-9529cab0ac41 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:48.589294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31106627-2c71-468e-9a18-9529cab0ac41 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:48.604378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 504/980] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:56:48 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:48.605181 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31106627-2c71-468e-9a18-9529cab0ac41 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:48.669406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf59668-6668-4ab9-8fbb-7f0d875161ed None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:48.677674 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:48.718343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d1f9c-4ee2-4304-90db-291d5f3a64a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:48.719304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d1f9c-4ee2-4304-90db-291d5f3a64a0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.719593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d1f9c-4ee2-4304-90db-291d5f3a64a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.719874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d1f9c-4ee2-4304-90db-291d5f3a64a0 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.720660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d1f9c-4ee2-4304-90db-291d5f3a64a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:48.722170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d1f9c-4ee2-4304-90db-291d5f3a64a0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:48.737109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 477/981] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jul 28 01:56:48 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 01:56:48.742469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31106627-2c71-468e-9a18-9529cab0ac41 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:48.782003 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f2585-bf97-49b4-ab29-a09da72a0d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:48.782725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f2585-bf97-49b4-ab29-a09da72a0d99 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.783011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f2585-bf97-49b4-ab29-a09da72a0d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.783287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f2585-bf97-49b4-ab29-a09da72a0d99 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.792923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f2585-bf97-49b4-ab29-a09da72a0d99 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:48.795005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f2585-bf97-49b4-ab29-a09da72a0d99 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-067f2585-bf97-49b4-ab29-a09da72a0d99 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:48.808929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:48.809996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:48.811000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 505/982] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jul 28 01:56:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:48.816837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d1f9c-4ee2-4304-90db-291d5f3a64a0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:48.922470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:48.932607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d1f9c-4ee2-4304-90db-291d5f3a64a0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:48.967819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd79f3-0667-4ee8-a0d2-88120f7d3982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:48.968481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd79f3-0667-4ee8-a0d2-88120f7d3982 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:48.968712 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd79f3-0667-4ee8-a0d2-88120f7d3982 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:48.968977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd79f3-0667-4ee8-a0d2-88120f7d3982 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:48.969770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd79f3-0667-4ee8-a0d2-88120f7d3982 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:48.970076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd79f3-0667-4ee8-a0d2-88120f7d3982 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:48.971529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd79f3-0667-4ee8-a0d2-88120f7d3982 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:48.990041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 478/983] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Jul 28 01:56:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:48.995937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f2585-bf97-49b4-ab29-a09da72a0d99 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:49.101724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f2585-bf97-49b4-ab29-a09da72a0d99 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:49.114610 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:49.136865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919b5e-4c78-4f83-a0d0-b1a4500a0889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:49.137476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919b5e-4c78-4f83-a0d0-b1a4500a0889 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:49.137751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919b5e-4c78-4f83-a0d0-b1a4500a0889 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:49.138019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919b5e-4c78-4f83-a0d0-b1a4500a0889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:49.205759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1919b5e-4c78-4f83-a0d0-b1a4500a0889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:49.207304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1919b5e-4c78-4f83-a0d0-b1a4500a0889 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:49.311620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 506/984] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:48 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:56:49.313682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd79f3-0667-4ee8-a0d2-88120f7d3982 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:49.420788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd79f3-0667-4ee8-a0d2-88120f7d3982 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:49.455180 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846035f3-43b9-4744-8ebb-ea4e58b1624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:49.455870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846035f3-43b9-4744-8ebb-ea4e58b1624b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:49.456092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846035f3-43b9-4744-8ebb-ea4e58b1624b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:49.456358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846035f3-43b9-4744-8ebb-ea4e58b1624b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:49.466177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846035f3-43b9-4744-8ebb-ea4e58b1624b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:49.467647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846035f3-43b9-4744-8ebb-ea4e58b1624b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-846035f3-43b9-4744-8ebb-ea4e58b1624b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:49.482475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:49.483386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:49.484281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:49.484281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:49.484281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:49.484281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:49.486527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 479/985] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:49.489485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919b5e-4c78-4f83-a0d0-b1a4500a0889 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:49.504605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:49.594872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919b5e-4c78-4f83-a0d0-b1a4500a0889 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:49.629624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84640f08-48ea-4c41-8aab-d015e76c3865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:49.630236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84640f08-48ea-4c41-8aab-d015e76c3865 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:49.630543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84640f08-48ea-4c41-8aab-d015e76c3865 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:49.630818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84640f08-48ea-4c41-8aab-d015e76c3865 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:49.631511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84640f08-48ea-4c41-8aab-d015e76c3865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:49.631815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84640f08-48ea-4c41-8aab-d015e76c3865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:49.633805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84640f08-48ea-4c41-8aab-d015e76c3865 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:49.649206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 507/986] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:49.650765 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846035f3-43b9-4744-8ebb-ea4e58b1624b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:49.653789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:49.757107 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846035f3-43b9-4744-8ebb-ea4e58b1624b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:49.790954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6292fcd-6bb2-4351-80be-dec70c6cb444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:49.791589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292fcd-6bb2-4351-80be-dec70c6cb444 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:49.791866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292fcd-6bb2-4351-80be-dec70c6cb444 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:49.792136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292fcd-6bb2-4351-80be-dec70c6cb444 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:49.798826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6292fcd-6bb2-4351-80be-dec70c6cb444 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:49.800245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6292fcd-6bb2-4351-80be-dec70c6cb444 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d6292fcd-6bb2-4351-80be-dec70c6cb444 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:49.812343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:49.813242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:49.814120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:49.814120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:49.814120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:49.814120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:49.814120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:49.814120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:49.814120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:49.814120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:49.814120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 480/987] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:49.819777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84640f08-48ea-4c41-8aab-d015e76c3865 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:49.902196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:49.934889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84640f08-48ea-4c41-8aab-d015e76c3865 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:49.968465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f8463-abd6-467d-b0a8-b95bf1c230f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:49.969078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f8463-abd6-467d-b0a8-b95bf1c230f4 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:49.969360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f8463-abd6-467d-b0a8-b95bf1c230f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:49.969633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f8463-abd6-467d-b0a8-b95bf1c230f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:49.970384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f8463-abd6-467d-b0a8-b95bf1c230f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:49.970721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f8463-abd6-467d-b0a8-b95bf1c230f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:49.972161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f8463-abd6-467d-b0a8-b95bf1c230f4 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:49.984801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 508/988] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:49.990577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6292fcd-6bb2-4351-80be-dec70c6cb444 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:50.053512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:50.096927 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6292fcd-6bb2-4351-80be-dec70c6cb444 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:50.133808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5833451-99fa-4a66-908e-7aaf9057e3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:50.134428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833451-99fa-4a66-908e-7aaf9057e3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:50.134736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833451-99fa-4a66-908e-7aaf9057e3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:50.135009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833451-99fa-4a66-908e-7aaf9057e3c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:50.135801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5833451-99fa-4a66-908e-7aaf9057e3c7 None admin] RBAC: Adding query filter params (role.id=05383c83ec49434b82842b6b3c0c4b38, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=39169d922474437ebb7605d4a34dd7ec) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:50.136110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5833451-99fa-4a66-908e-7aaf9057e3c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:50.137544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5833451-99fa-4a66-908e-7aaf9057e3c7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:50.150531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 481/989] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:49 2022] GET /identity/v3/role_assignments?user.id=39169d922474437ebb7605d4a34dd7ec&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=05383c83ec49434b82842b6b3c0c4b38 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:50.640742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92ffb6-b133-493a-98de-b2fd67265c37 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:50.641249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92ffb6-b133-493a-98de-b2fd67265c37 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:50.641249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92ffb6-b133-493a-98de-b2fd67265c37 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:50.642807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 509/990] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:50.648059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a388be4-7a5a-4850-bb04-c03e41229e00 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:50.648918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a388be4-7a5a-4850-bb04-c03e41229e00 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:50.649194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a388be4-7a5a-4850-bb04-c03e41229e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:50.667191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6a388be4-7a5a-4850-bb04-c03e41229e00 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:50.668369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6a388be4-7a5a-4850-bb04-c03e41229e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:50.735268 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 482/991] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:50.746317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f662a2a-4955-4941-988d-a63e11d42e9b None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:50.746638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f662a2a-4955-4941-988d-a63e11d42e9b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:50.746913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f662a2a-4955-4941-988d-a63e11d42e9b None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:50.748367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 510/992] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:50.753109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49eb95-9423-4d11-afb0-15ad1d68e1ed None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:50.753395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49eb95-9423-4d11-afb0-15ad1d68e1ed None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:50.753669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49eb95-9423-4d11-afb0-15ad1d68e1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:50.756297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f662a2a-4955-4941-988d-a63e11d42e9b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:50.771761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-bd49eb95-9423-4d11-afb0-15ad1d68e1ed None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:50.772939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bd49eb95-9423-4d11-afb0-15ad1d68e1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:50.825974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:50.844273 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 483/993] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:50.865489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f662a2a-4955-4941-988d-a63e11d42e9b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:50.865805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49eb95-9423-4d11-afb0-15ad1d68e1ed None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:50.900627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:50.906146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3d300-3be6-49d4-aa61-1f6ece68d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:50.906874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d300-3be6-49d4-aa61-1f6ece68d81f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:50.907152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d300-3be6-49d4-aa61-1f6ece68d81f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:50.907447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d300-3be6-49d4-aa61-1f6ece68d81f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:50.908132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3d300-3be6-49d4-aa61-1f6ece68d81f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:50.909537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3d300-3be6-49d4-aa61-1f6ece68d81f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-5ba3d300-3be6-49d4-aa61-1f6ece68d81f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:50.918552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:50.919560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:50.920399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 511/994] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:50.925356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3d300-3be6-49d4-aa61-1f6ece68d81f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:50.978408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49eb95-9423-4d11-afb0-15ad1d68e1ed None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:51.015303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a623bfa-9545-4d83-b358-92c7d870a05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:51.016170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a623bfa-9545-4d83-b358-92c7d870a05d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:51.016304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a623bfa-9545-4d83-b358-92c7d870a05d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:51.016573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a623bfa-9545-4d83-b358-92c7d870a05d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:51.017189 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a623bfa-9545-4d83-b358-92c7d870a05d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:51.018719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a623bfa-9545-4d83-b358-92c7d870a05d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1a623bfa-9545-4d83-b358-92c7d870a05d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:51.028043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:51.029009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:51.029858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 484/995] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Jul 28 01:56:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:51.034303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3d300-3be6-49d4-aa61-1f6ece68d81f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:51.035035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a623bfa-9545-4d83-b358-92c7d870a05d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:51.069389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4be55-f5c6-4826-a3cc-c266728880e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:51.069998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4be55-f5c6-4826-a3cc-c266728880e9 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:51.072427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4be55-f5c6-4826-a3cc-c266728880e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:51.072427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4be55-f5c6-4826-a3cc-c266728880e9 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:51.072427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4be55-f5c6-4826-a3cc-c266728880e9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:51.072427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4be55-f5c6-4826-a3cc-c266728880e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:51.073472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4be55-f5c6-4826-a3cc-c266728880e9 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:51.083102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 512/996] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:51.083979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4be55-f5c6-4826-a3cc-c266728880e9 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:51.095493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:51.145988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:51.150573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a623bfa-9545-4d83-b358-92c7d870a05d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:51.186044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e9e36-110c-4994-9e1b-3a673851e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:51.186627 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e9e36-110c-4994-9e1b-3a673851e2bc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:51.186886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e9e36-110c-4994-9e1b-3a673851e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:51.187157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e9e36-110c-4994-9e1b-3a673851e2bc None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:51.187833 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e9e36-110c-4994-9e1b-3a673851e2bc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:51.188143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e9e36-110c-4994-9e1b-3a673851e2bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:51.188376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4be55-f5c6-4826-a3cc-c266728880e9 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:51.189527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e9e36-110c-4994-9e1b-3a673851e2bc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:51.194895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 485/997] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jul 28 01:56:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:51.200966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e9e36-110c-4994-9e1b-3a673851e2bc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:51.224051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af7c9-3349-456c-a397-4f96ba70dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:51.224904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af7c9-3349-456c-a397-4f96ba70dec2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:51.225183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af7c9-3349-456c-a397-4f96ba70dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:51.225456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af7c9-3349-456c-a397-4f96ba70dec2 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:51.226133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96af7c9-3349-456c-a397-4f96ba70dec2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:51.226583 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96af7c9-3349-456c-a397-4f96ba70dec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:51.227960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96af7c9-3349-456c-a397-4f96ba70dec2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:51.233248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 513/998] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:51.239037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af7c9-3349-456c-a397-4f96ba70dec2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:51.315504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e9e36-110c-4994-9e1b-3a673851e2bc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:51.332183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:51.348556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af7c9-3349-456c-a397-4f96ba70dec2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:51.354453 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f86f6e-e462-4e25-a8f4-9a6d3ab0f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:51.355086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86f6e-e462-4e25-a8f4-9a6d3ab0f8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:51.355368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86f6e-e462-4e25-a8f4-9a6d3ab0f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:51.355641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86f6e-e462-4e25-a8f4-9a6d3ab0f8e4 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:51.356328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f86f6e-e462-4e25-a8f4-9a6d3ab0f8e4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:51.356633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f86f6e-e462-4e25-a8f4-9a6d3ab0f8e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:51.358003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f86f6e-e462-4e25-a8f4-9a6d3ab0f8e4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:51.363560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 486/999] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Jul 28 01:56:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:51.370534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f86f6e-e462-4e25-a8f4-9a6d3ab0f8e4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:51.374396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:51.385795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b42c4-d44b-4879-bc5e-4f823c9a3f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:51.386414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b42c4-d44b-4879-bc5e-4f823c9a3f82 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:51.386719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b42c4-d44b-4879-bc5e-4f823c9a3f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:51.386989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b42c4-d44b-4879-bc5e-4f823c9a3f82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:51.387753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b42c4-d44b-4879-bc5e-4f823c9a3f82 None admin] RBAC: Adding query filter params (interface=public, service_id=76dd2fc18acb4b798c22b605d336ff57, region_id=RegionOne) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:51.388068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b42c4-d44b-4879-bc5e-4f823c9a3f82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:51.389440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b42c4-d44b-4879-bc5e-4f823c9a3f82 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:51.394633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 514/1000] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jul 28 01:56:51 2022] GET /identity/v3/endpoints?service_id=76dd2fc18acb4b798c22b605d336ff57&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:51.399879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b42c4-d44b-4879-bc5e-4f823c9a3f82 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:51.478356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f86f6e-e462-4e25-a8f4-9a6d3ab0f8e4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:51.503064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b42c4-d44b-4879-bc5e-4f823c9a3f82 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:51.513676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24158a2-5cf0-40ef-88c1-4811687e76ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:51.514511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24158a2-5cf0-40ef-88c1-4811687e76ec None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:51.514957 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24158a2-5cf0-40ef-88c1-4811687e76ec None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:51.515488 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24158a2-5cf0-40ef-88c1-4811687e76ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:51.516463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24158a2-5cf0-40ef-88c1-4811687e76ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:51.517825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24158a2-5cf0-40ef-88c1-4811687e76ec None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:51.534519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 487/1001] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 01:56:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 01:56:51.543930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb20849-5c2d-482b-bf60-a7f1019b2cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:51.544568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb20849-5c2d-482b-bf60-a7f1019b2cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:51.544850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb20849-5c2d-482b-bf60-a7f1019b2cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:51.545127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb20849-5c2d-482b-bf60-a7f1019b2cf1 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:51.545798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb20849-5c2d-482b-bf60-a7f1019b2cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:51.547249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb20849-5c2d-482b-bf60-a7f1019b2cf1 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:51.555289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 515/1002] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jul 28 01:56:51 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 01:56:52.170675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2705ab-4d19-43b2-8b2f-a9c2d8872732 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:52.171182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2705ab-4d19-43b2-8b2f-a9c2d8872732 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:52.171182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2705ab-4d19-43b2-8b2f-a9c2d8872732 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:52.172641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 488/1003] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:52.177558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1486a52-2832-44dc-94d3-693909b7af23 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:52.177955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1486a52-2832-44dc-94d3-693909b7af23 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:52.178133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1486a52-2832-44dc-94d3-693909b7af23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:52.196686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-b1486a52-2832-44dc-94d3-693909b7af23 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:52.197854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b1486a52-2832-44dc-94d3-693909b7af23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:52.242615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:52.268536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 516/1004] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:52.290161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2705ab-4d19-43b2-8b2f-a9c2d8872732 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:52.332280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:52.400324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2705ab-4d19-43b2-8b2f-a9c2d8872732 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:52.434816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cbd55-d6d7-4d85-a3f6-db0a614638c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:52.435382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cbd55-d6d7-4d85-a3f6-db0a614638c9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:52.435660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cbd55-d6d7-4d85-a3f6-db0a614638c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:52.435931 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cbd55-d6d7-4d85-a3f6-db0a614638c9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:52.436552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cbd55-d6d7-4d85-a3f6-db0a614638c9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:52.437915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cbd55-d6d7-4d85-a3f6-db0a614638c9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-539cbd55-d6d7-4d85-a3f6-db0a614638c9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:52.447651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:52.448610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:52.449569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 489/1005] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Jul 28 01:56:52 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:52.454660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1486a52-2832-44dc-94d3-693909b7af23 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:52.551199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1486a52-2832-44dc-94d3-693909b7af23 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:52.585093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949ee8a-08a5-499f-91d8-82657bf4fcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:52.585728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949ee8a-08a5-499f-91d8-82657bf4fcea None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:52.586003 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949ee8a-08a5-499f-91d8-82657bf4fcea None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:52.586271 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949ee8a-08a5-499f-91d8-82657bf4fcea None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:52.586976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949ee8a-08a5-499f-91d8-82657bf4fcea None admin] RBAC: Adding query filter params (name=image) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:52.587281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949ee8a-08a5-499f-91d8-82657bf4fcea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:52.588646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949ee8a-08a5-499f-91d8-82657bf4fcea None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:52.596756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 517/1006] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:52.599964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cbd55-d6d7-4d85-a3f6-db0a614638c9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:52.706596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cbd55-d6d7-4d85-a3f6-db0a614638c9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:52.708047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:52.743044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4c3cb-46f6-4419-9229-b81a98041ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:52.743657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4c3cb-46f6-4419-9229-b81a98041ded None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:52.743933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4c3cb-46f6-4419-9229-b81a98041ded None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:52.744198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4c3cb-46f6-4419-9229-b81a98041ded None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:52.744867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4c3cb-46f6-4419-9229-b81a98041ded None admin] RBAC: Adding query filter params (type=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:52.745164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4c3cb-46f6-4419-9229-b81a98041ded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:52.746541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4c3cb-46f6-4419-9229-b81a98041ded None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:52.758511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 490/1007] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:53.578039 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6be971-ac88-40fe-b4e5-349fe1fc1095 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:53.578634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6be971-ac88-40fe-b4e5-349fe1fc1095 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:53.578634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6be971-ac88-40fe-b4e5-349fe1fc1095 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:53.580088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 518/1008] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:53.580856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d5420-6a95-44c4-bbbc-e0755bcdd328 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:53.581288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d5420-6a95-44c4-bbbc-e0755bcdd328 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:53.581456 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d5420-6a95-44c4-bbbc-e0755bcdd328 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:53.582782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 491/1009] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:53.584827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf893e9-3896-4244-9213-e33e22c56336 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:53.585113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf893e9-3896-4244-9213-e33e22c56336 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:53.585385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf893e9-3896-4244-9213-e33e22c56336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:53.587886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56ae90-8724-45a7-a378-c251935194da None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:53.588166 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56ae90-8724-45a7-a378-c251935194da None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:53.588435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56ae90-8724-45a7-a378-c251935194da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:53.604907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-bbf893e9-3896-4244-9213-e33e22c56336 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:53.606106 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-bbf893e9-3896-4244-9213-e33e22c56336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:53.606501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0b56ae90-8724-45a7-a378-c251935194da None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:53.607643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0b56ae90-8724-45a7-a378-c251935194da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:53.644190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:53.676551 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 492/1010] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:53.682338 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 519/1011] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:53.698741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56ae90-8724-45a7-a378-c251935194da None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:53.705246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf893e9-3896-4244-9213-e33e22c56336 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:53.793808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:53.800883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56ae90-8724-45a7-a378-c251935194da None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:53.809913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf893e9-3896-4244-9213-e33e22c56336 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:53.838281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263309b8-8f7d-419a-af47-04d3784103a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:53.838880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263309b8-8f7d-419a-af47-04d3784103a8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:53.839155 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263309b8-8f7d-419a-af47-04d3784103a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:53.839426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263309b8-8f7d-419a-af47-04d3784103a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:53.840063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263309b8-8f7d-419a-af47-04d3784103a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:53.841460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263309b8-8f7d-419a-af47-04d3784103a8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:53.849483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4af3b-4881-482b-9d69-d3b3ab89fd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:53.850125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4af3b-4881-482b-9d69-d3b3ab89fd7f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:53.850403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4af3b-4881-482b-9d69-d3b3ab89fd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:53.850705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4af3b-4881-482b-9d69-d3b3ab89fd7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-263309b8-8f7d-419a-af47-04d3784103a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:53.851134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:53.852097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:53.853007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 493/1012] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:53.855088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4af3b-4881-482b-9d69-d3b3ab89fd7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:53.856528 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4af3b-4881-482b-9d69-d3b3ab89fd7f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:53.858048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263309b8-8f7d-419a-af47-04d3784103a8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:53.862939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 520/1013] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:53.863775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4af3b-4881-482b-9d69-d3b3ab89fd7f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:53.910859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:53.969271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263309b8-8f7d-419a-af47-04d3784103a8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:53.973908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4af3b-4881-482b-9d69-d3b3ab89fd7f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:54.004853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a34b15-9b5a-4893-bc29-65d085b8cb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:54.005667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a34b15-9b5a-4893-bc29-65d085b8cb50 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:54.006089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a34b15-9b5a-4893-bc29-65d085b8cb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:54.006552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a34b15-9b5a-4893-bc29-65d085b8cb50 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:54.007361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a34b15-9b5a-4893-bc29-65d085b8cb50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:54.008387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a34b15-9b5a-4893-bc29-65d085b8cb50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:54.009397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d811a-cdc3-451f-bab9-9a8ce29cfbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:54.010038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d811a-cdc3-451f-bab9-9a8ce29cfbc5 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:54.010221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a34b15-9b5a-4893-bc29-65d085b8cb50 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:54.010328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d811a-cdc3-451f-bab9-9a8ce29cfbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:54.010621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d811a-cdc3-451f-bab9-9a8ce29cfbc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:54.011309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d811a-cdc3-451f-bab9-9a8ce29cfbc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:54.012718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d811a-cdc3-451f-bab9-9a8ce29cfbc5 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:54.016182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 494/1014] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:54.021393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a34b15-9b5a-4893-bc29-65d085b8cb50 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:54.045987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 521/1015] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:56:53 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:54.056734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:54.147690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a34b15-9b5a-4893-bc29-65d085b8cb50 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:54.184177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07785f3a-0625-4502-8d28-a84e8b864cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:54.184810 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07785f3a-0625-4502-8d28-a84e8b864cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:54.185085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07785f3a-0625-4502-8d28-a84e8b864cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:54.185353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07785f3a-0625-4502-8d28-a84e8b864cd3 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:54.186039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07785f3a-0625-4502-8d28-a84e8b864cd3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:54.186342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07785f3a-0625-4502-8d28-a84e8b864cd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:54.187757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07785f3a-0625-4502-8d28-a84e8b864cd3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:54.198719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 495/1016] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Jul 28 01:56:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:54.200227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d811a-cdc3-451f-bab9-9a8ce29cfbc5 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:54.298427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:54.309098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d811a-cdc3-451f-bab9-9a8ce29cfbc5 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:54.343807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ccbe7-e09f-4819-a440-e5a045fd7be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:54.344421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ccbe7-e09f-4819-a440-e5a045fd7be3 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:54.344695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ccbe7-e09f-4819-a440-e5a045fd7be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:54.344965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ccbe7-e09f-4819-a440-e5a045fd7be3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:54.345679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ccbe7-e09f-4819-a440-e5a045fd7be3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:54.347077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ccbe7-e09f-4819-a440-e5a045fd7be3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:54.367856 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 522/1017] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 01:56:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:54.744001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40be59-5b67-4b0b-a6b2-e4adc801712f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:54.744534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40be59-5b67-4b0b-a6b2-e4adc801712f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:54.744534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40be59-5b67-4b0b-a6b2-e4adc801712f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:54.746056 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 496/1018] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:54.750985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561e34-7272-4993-9dc3-97ebfe00e98e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:54.751362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561e34-7272-4993-9dc3-97ebfe00e98e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:54.751578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561e34-7272-4993-9dc3-97ebfe00e98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:54.770119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-3e561e34-7272-4993-9dc3-97ebfe00e98e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:54.771342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3e561e34-7272-4993-9dc3-97ebfe00e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:54.845108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 523/1019] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:54.867494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40be59-5b67-4b0b-a6b2-e4adc801712f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:54.960430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:54.974153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40be59-5b67-4b0b-a6b2-e4adc801712f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:55.009017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db58a-cff5-4f31-b60f-878803067032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:55.009612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db58a-cff5-4f31-b60f-878803067032 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:55.009884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db58a-cff5-4f31-b60f-878803067032 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:55.010152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db58a-cff5-4f31-b60f-878803067032 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:55.010927 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53db58a-cff5-4f31-b60f-878803067032 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:55.012276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53db58a-cff5-4f31-b60f-878803067032 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:55.034475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 497/1020] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:56:54 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:56.129607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb13548-850e-4e5b-b63b-65fc0e7ecc45 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:56.130110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb13548-850e-4e5b-b63b-65fc0e7ecc45 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:56.130110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb13548-850e-4e5b-b63b-65fc0e7ecc45 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:56.131750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 524/1021] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:56.137908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdfb26-e317-40dd-86eb-fc9df6411ead None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:56.138548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdfb26-e317-40dd-86eb-fc9df6411ead None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:56.138548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdfb26-e317-40dd-86eb-fc9df6411ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:56.158231 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e4bdfb26-e317-40dd-86eb-fc9df6411ead None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:56.159469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e4bdfb26-e317-40dd-86eb-fc9df6411ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:56.234563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 498/1022] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:56:56.259096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb13548-850e-4e5b-b63b-65fc0e7ecc45 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:56.335838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:56.363610 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb13548-850e-4e5b-b63b-65fc0e7ecc45 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:56.398552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9f3e4-2e1d-44cd-9dfd-e3c9e3bbcb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:56.399122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9f3e4-2e1d-44cd-9dfd-e3c9e3bbcb42 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:56.399405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9f3e4-2e1d-44cd-9dfd-e3c9e3bbcb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:56.399681 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9f3e4-2e1d-44cd-9dfd-e3c9e3bbcb42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:56.400847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9f3e4-2e1d-44cd-9dfd-e3c9e3bbcb42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:56.402300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9f3e4-2e1d-44cd-9dfd-e3c9e3bbcb42 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:56.408625 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 525/1023] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:56.410117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdfb26-e317-40dd-86eb-fc9df6411ead None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:56.455461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a46a1e-7664-48da-9e41-c9cef86e90e6 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:56.455834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a46a1e-7664-48da-9e41-c9cef86e90e6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:56.456266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a46a1e-7664-48da-9e41-c9cef86e90e6 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:56.457335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 526/1024] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:56.462031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1d3a-f33a-431e-afb4-49e884fddf77 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:56.462307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1d3a-f33a-431e-afb4-49e884fddf77 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:56.462619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1d3a-f33a-431e-afb4-49e884fddf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:56.480513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-950d1d3a-f33a-431e-afb4-49e884fddf77 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:56.481678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-950d1d3a-f33a-431e-afb4-49e884fddf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:56.490462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:56.520585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdfb26-e317-40dd-86eb-fc9df6411ead None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:56.556156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 527/1025] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:56.557881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc12878-a3cb-4ca6-bbd0-3c3a1693f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:56.558574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc12878-a3cb-4ca6-bbd0-3c3a1693f2be None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:56.558796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc12878-a3cb-4ca6-bbd0-3c3a1693f2be None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:56.559062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc12878-a3cb-4ca6-bbd0-3c3a1693f2be None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:56.559730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc12878-a3cb-4ca6-bbd0-3c3a1693f2be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:56.561140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc12878-a3cb-4ca6-bbd0-3c3a1693f2be None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:56.579693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d1d3a-f33a-431e-afb4-49e884fddf77 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:56.585378 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 499/1026] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:56:56 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:56:56.660128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:56.694387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d1d3a-f33a-431e-afb4-49e884fddf77 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:56.730888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84929bc5-e564-42e8-8bfa-38c079677b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:56.731538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84929bc5-e564-42e8-8bfa-38c079677b96 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:56.731815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84929bc5-e564-42e8-8bfa-38c079677b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:56.732086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84929bc5-e564-42e8-8bfa-38c079677b96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:56.745626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84929bc5-e564-42e8-8bfa-38c079677b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-84929bc5-e564-42e8-8bfa-38c079677b96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:56.750612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:56.751551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:56.752402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 528/1027] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jul 28 01:56:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:56.757709 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc12878-a3cb-4ca6-bbd0-3c3a1693f2be None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:56.868407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc12878-a3cb-4ca6-bbd0-3c3a1693f2be None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:56.897939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:56.904887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff52b9-0319-4246-9acb-36882a179382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:56.905513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff52b9-0319-4246-9acb-36882a179382 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:56.906155 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff52b9-0319-4246-9acb-36882a179382 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:56.906752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff52b9-0319-4246-9acb-36882a179382 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:56.907795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff52b9-0319-4246-9acb-36882a179382 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:56.908098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff52b9-0319-4246-9acb-36882a179382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:56.909486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff52b9-0319-4246-9acb-36882a179382 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:56.918774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 500/1028] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jul 28 01:56:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:56.924593 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84929bc5-e564-42e8-8bfa-38c079677b96 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.026506 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84929bc5-e564-42e8-8bfa-38c079677b96 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:57.042060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba149-9c31-4206-af29-8534f38ee620 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.042348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba149-9c31-4206-af29-8534f38ee620 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.042657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba149-9c31-4206-af29-8534f38ee620 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.044146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 501/1029] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:56:57.048685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438773a-018d-443d-8fe4-2aa849ecf701 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.048975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438773a-018d-443d-8fe4-2aa849ecf701 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.049265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438773a-018d-443d-8fe4-2aa849ecf701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.056752 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:57.062838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba77ccc-207e-4fef-8832-8c6456ca3314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:57.063473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba77ccc-207e-4fef-8832-8c6456ca3314 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.063756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba77ccc-207e-4fef-8832-8c6456ca3314 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.064024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba77ccc-207e-4fef-8832-8c6456ca3314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.067992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0438773a-018d-443d-8fe4-2aa849ecf701 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:57.069244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0438773a-018d-443d-8fe4-2aa849ecf701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:57.074951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba77ccc-207e-4fef-8832-8c6456ca3314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:57.077124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba77ccc-207e-4fef-8832-8c6456ca3314 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-0ba77ccc-207e-4fef-8832-8c6456ca3314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:57.095398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:57.096349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:57.097248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:57.097248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:57.097248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:57.097248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:57.097248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 529/1030] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:57.102784 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba77ccc-207e-4fef-8832-8c6456ca3314 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.142474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 502/1031] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:57.163320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438773a-018d-443d-8fe4-2aa849ecf701 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.219078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba77ccc-207e-4fef-8832-8c6456ca3314 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:57.252929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce36aa-263c-407b-91fb-39f945d6899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:57.253542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce36aa-263c-407b-91fb-39f945d6899b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.253820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce36aa-263c-407b-91fb-39f945d6899b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.254093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce36aa-263c-407b-91fb-39f945d6899b None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.254818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce36aa-263c-407b-91fb-39f945d6899b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:57.255122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce36aa-263c-407b-91fb-39f945d6899b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:57.256496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce36aa-263c-407b-91fb-39f945d6899b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:57.269031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 530/1032] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:57.274800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce36aa-263c-407b-91fb-39f945d6899b None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.278775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438773a-018d-443d-8fe4-2aa849ecf701 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:57.303679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:57.317779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c65176-47b7-4436-840c-7db3559ad50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:57.318587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c65176-47b7-4436-840c-7db3559ad50c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.318889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c65176-47b7-4436-840c-7db3559ad50c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.319237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c65176-47b7-4436-840c-7db3559ad50c None admin] PATH_INFO: `/v3/services/image` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.319857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c65176-47b7-4436-840c-7db3559ad50c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:57.321760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c65176-47b7-4436-840c-7db3559ad50c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-07c65176-47b7-4436-840c-7db3559ad50c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:57.330963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:57.331922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:57.332785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 503/1033] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Jul 28 01:56:57 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:57.335072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:57.338743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c65176-47b7-4436-840c-7db3559ad50c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.398138 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce36aa-263c-407b-91fb-39f945d6899b None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:57.435993 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2298af-8271-4e37-9c89-0c625e94ba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:57.436630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2298af-8271-4e37-9c89-0c625e94ba82 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.436912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2298af-8271-4e37-9c89-0c625e94ba82 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.437187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2298af-8271-4e37-9c89-0c625e94ba82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.445707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2298af-8271-4e37-9c89-0c625e94ba82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:57.446729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c65176-47b7-4436-840c-7db3559ad50c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:57.447183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2298af-8271-4e37-9c89-0c625e94ba82 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-be2298af-8271-4e37-9c89-0c625e94ba82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:56:57.459745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:57.461381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:57.462326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 531/1034] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jul 28 01:56:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:56:57.467018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2298af-8271-4e37-9c89-0c625e94ba82 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.485658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67567e92-8b46-404a-a09b-741a18f8a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:57.486539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67567e92-8b46-404a-a09b-741a18f8a07d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.486828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67567e92-8b46-404a-a09b-741a18f8a07d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.487106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67567e92-8b46-404a-a09b-741a18f8a07d None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.487785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67567e92-8b46-404a-a09b-741a18f8a07d None admin] RBAC: Adding query filter params (name=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:57.488095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67567e92-8b46-404a-a09b-741a18f8a07d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:57.489940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67567e92-8b46-404a-a09b-741a18f8a07d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:57.495201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 504/1035] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:57.500768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67567e92-8b46-404a-a09b-741a18f8a07d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.553747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:57.571591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2298af-8271-4e37-9c89-0c625e94ba82 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:57.575246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:57.608605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7559a3d-160b-4e1e-b995-74911d853edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:57.609218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7559a3d-160b-4e1e-b995-74911d853edd None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.609500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7559a3d-160b-4e1e-b995-74911d853edd None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.609774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7559a3d-160b-4e1e-b995-74911d853edd None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.609873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67567e92-8b46-404a-a09b-741a18f8a07d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:57.610605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7559a3d-160b-4e1e-b995-74911d853edd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:57.610917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7559a3d-160b-4e1e-b995-74911d853edd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:57.612358 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7559a3d-160b-4e1e-b995-74911d853edd None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:57.630305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 532/1036] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jul 28 01:56:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:57.636416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7559a3d-160b-4e1e-b995-74911d853edd None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.651230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94537d2e-27c5-4ded-ba7b-901bb303faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:57.651851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94537d2e-27c5-4ded-ba7b-901bb303faf7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.652133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94537d2e-27c5-4ded-ba7b-901bb303faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.652443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94537d2e-27c5-4ded-ba7b-901bb303faf7 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.653124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94537d2e-27c5-4ded-ba7b-901bb303faf7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:57.653425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94537d2e-27c5-4ded-ba7b-901bb303faf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:57.654863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94537d2e-27c5-4ded-ba7b-901bb303faf7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:57.660415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 505/1037] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:57.665793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94537d2e-27c5-4ded-ba7b-901bb303faf7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.743117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7559a3d-160b-4e1e-b995-74911d853edd None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:57.768370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94537d2e-27c5-4ded-ba7b-901bb303faf7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:57.779966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77f14f-77df-4112-acb7-23f54d4d08d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:57.780609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77f14f-77df-4112-acb7-23f54d4d08d2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.780890 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77f14f-77df-4112-acb7-23f54d4d08d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.781162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77f14f-77df-4112-acb7-23f54d4d08d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.785931 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:57.811419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9e036-4cd6-4fc6-92d5-f0aba83a4c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:57.812039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9e036-4cd6-4fc6-92d5-f0aba83a4c52 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.812320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9e036-4cd6-4fc6-92d5-f0aba83a4c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.812588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9e036-4cd6-4fc6-92d5-f0aba83a4c52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.813501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9e036-4cd6-4fc6-92d5-f0aba83a4c52 None admin] RBAC: Adding query filter params (interface=public, service_id=bbc97aa14793430a8953536be3b24400, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:57.813807 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9e036-4cd6-4fc6-92d5-f0aba83a4c52 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:57.815314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9e036-4cd6-4fc6-92d5-f0aba83a4c52 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:57.819835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:57.822191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 506/1038] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jul 28 01:56:57 2022] GET /identity/v3/endpoints?service_id=bbc97aa14793430a8953536be3b24400&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:56:57.827893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9e036-4cd6-4fc6-92d5-f0aba83a4c52 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.866370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77f14f-77df-4112-acb7-23f54d4d08d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:57.868513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77f14f-77df-4112-acb7-23f54d4d08d2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:57.939858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9e036-4cd6-4fc6-92d5-f0aba83a4c52 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:57.974214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d831229-1f66-4a43-ba4c-bf4317cfe7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:57.974851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d831229-1f66-4a43-ba4c-bf4317cfe7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:57.975158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d831229-1f66-4a43-ba4c-bf4317cfe7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:57.975389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d831229-1f66-4a43-ba4c-bf4317cfe7c3 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:57.980220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 533/1039] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 01:56:57.980349 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d831229-1f66-4a43-ba4c-bf4317cfe7c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:57.980349 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d831229-1f66-4a43-ba4c-bf4317cfe7c3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:57.981490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77f14f-77df-4112-acb7-23f54d4d08d2 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:57.984111 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 507/1040] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jul 28 01:56:57 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 01:56:58.048300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:58.090983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77f14f-77df-4112-acb7-23f54d4d08d2 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:58.128270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e84eb9-5f87-4f0a-b556-60d6f255e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:58.128967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e84eb9-5f87-4f0a-b556-60d6f255e277 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:58.129247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e84eb9-5f87-4f0a-b556-60d6f255e277 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:58.129571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e84eb9-5f87-4f0a-b556-60d6f255e277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:58.140832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e84eb9-5f87-4f0a-b556-60d6f255e277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:58.142283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e84eb9-5f87-4f0a-b556-60d6f255e277 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-88e84eb9-5f87-4f0a-b556-60d6f255e277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:56:58.158239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:58.159290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:58.160171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:56:58.160171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:56:58.160171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:56:58.160171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:58.160171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 534/1041] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:58.166292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d831229-1f66-4a43-ba4c-bf4317cfe7c3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:58.218618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:58.276727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d831229-1f66-4a43-ba4c-bf4317cfe7c3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:58.310726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084ded-0754-4f7d-a523-778e493db01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:58.311259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084ded-0754-4f7d-a523-778e493db01f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:58.311534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084ded-0754-4f7d-a523-778e493db01f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:58.311800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084ded-0754-4f7d-a523-778e493db01f None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:58.312478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b084ded-0754-4f7d-a523-778e493db01f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:58.312777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b084ded-0754-4f7d-a523-778e493db01f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:58.314136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b084ded-0754-4f7d-a523-778e493db01f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:58.326537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 508/1042] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:58.331909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e84eb9-5f87-4f0a-b556-60d6f255e277 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:58.445116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e84eb9-5f87-4f0a-b556-60d6f255e277 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:58.459542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:58.481350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d5ccf-87b5-4ed7-9ee4-eb8dac34e69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:58.481988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d5ccf-87b5-4ed7-9ee4-eb8dac34e69c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:58.482268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d5ccf-87b5-4ed7-9ee4-eb8dac34e69c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:58.482570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d5ccf-87b5-4ed7-9ee4-eb8dac34e69c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:58.489221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d5ccf-87b5-4ed7-9ee4-eb8dac34e69c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:58.490681 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d5ccf-87b5-4ed7-9ee4-eb8dac34e69c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-bd5d5ccf-87b5-4ed7-9ee4-eb8dac34e69c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:56:58.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:58.502773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:58.503656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:56:58.503656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:56:58.503656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:56:58.503656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:56:58.503656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:56:58.503656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:56:58.503656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:56:58.503656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:56:58.506766 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 535/1043] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:56:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:58.508727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084ded-0754-4f7d-a523-778e493db01f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:58.610599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084ded-0754-4f7d-a523-778e493db01f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:58.612071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:58.646790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd8e58-0f8b-4c6b-bc94-d0718e42a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:58.647401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd8e58-0f8b-4c6b-bc94-d0718e42a17d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:58.647676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd8e58-0f8b-4c6b-bc94-d0718e42a17d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:58.647943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd8e58-0f8b-4c6b-bc94-d0718e42a17d None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:58.648713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd8e58-0f8b-4c6b-bc94-d0718e42a17d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:58.649014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd8e58-0f8b-4c6b-bc94-d0718e42a17d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:58.650458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd8e58-0f8b-4c6b-bc94-d0718e42a17d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:58.667005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 509/1044] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:56:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:58.668214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d5ccf-87b5-4ed7-9ee4-eb8dac34e69c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:58.707973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ecc6a-c84e-437a-86a3-5e18694b0c8f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:58.708283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ecc6a-c84e-437a-86a3-5e18694b0c8f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:58.708533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ecc6a-c84e-437a-86a3-5e18694b0c8f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:58.710020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 510/1045] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:56:58.714886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de36c2-0728-427d-bb88-1b73e4236caf None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:58.715179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de36c2-0728-427d-bb88-1b73e4236caf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:58.715459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de36c2-0728-427d-bb88-1b73e4236caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:58.733483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a7de36c2-0728-427d-bb88-1b73e4236caf None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:56:58.734726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a7de36c2-0728-427d-bb88-1b73e4236caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:56:58.774404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d5ccf-87b5-4ed7-9ee4-eb8dac34e69c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:58.807015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 511/1046] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:56:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:56:58.808760 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffd40c-9fbc-44dc-8fec-734cc1fddf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:58.809365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffd40c-9fbc-44dc-8fec-734cc1fddf00 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:58.809643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffd40c-9fbc-44dc-8fec-734cc1fddf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:58.809913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffd40c-9fbc-44dc-8fec-734cc1fddf00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:58.810726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffd40c-9fbc-44dc-8fec-734cc1fddf00 None admin] RBAC: Adding query filter params (role.id=05383c83ec49434b82842b6b3c0c4b38, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=b9f911e716994f1f9d4705216ee0f3a5) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:58.811030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffd40c-9fbc-44dc-8fec-734cc1fddf00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:58.812462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffd40c-9fbc-44dc-8fec-734cc1fddf00 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:58.826735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 536/1047] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:58 2022] GET /identity/v3/role_assignments?user.id=b9f911e716994f1f9d4705216ee0f3a5&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=05383c83ec49434b82842b6b3c0c4b38 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:58.831135 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de36c2-0728-427d-bb88-1b73e4236caf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:58.936293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:58.947733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de36c2-0728-427d-bb88-1b73e4236caf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:58.986612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a21633-caee-4990-af83-e708ec78aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:58.987258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21633-caee-4990-af83-e708ec78aa63 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:58.987533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21633-caee-4990-af83-e708ec78aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:58.987802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21633-caee-4990-af83-e708ec78aa63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:58.998899 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a21633-caee-4990-af83-e708ec78aa63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-96a21633-caee-4990-af83-e708ec78aa63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:56:59.003838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:56:59.004731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:56:59.005563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 512/1048] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:56:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:56:59.011126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffd40c-9fbc-44dc-8fec-734cc1fddf00 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:59.052641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:59.117962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffd40c-9fbc-44dc-8fec-734cc1fddf00 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:59.152767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4313597-6985-4638-9ac8-5d637295f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:59.153291 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4313597-6985-4638-9ac8-5d637295f953 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:59.153572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4313597-6985-4638-9ac8-5d637295f953 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:59.153847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4313597-6985-4638-9ac8-5d637295f953 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:59.154608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4313597-6985-4638-9ac8-5d637295f953 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:59.154918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4313597-6985-4638-9ac8-5d637295f953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:59.156301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4313597-6985-4638-9ac8-5d637295f953 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:59.165941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 537/1049] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:56:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:59.171606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a21633-caee-4990-af83-e708ec78aa63 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:59.278992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a21633-caee-4990-af83-e708ec78aa63 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:59.312680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91726d26-539b-4538-8727-d1e11aa675c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:59.313314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91726d26-539b-4538-8727-d1e11aa675c7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:59.313590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91726d26-539b-4538-8727-d1e11aa675c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:59.313860 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91726d26-539b-4538-8727-d1e11aa675c7 None admin] PATH_INFO: `/v3/users/a8d4aca0466d451997a4d39609349c94` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:59.327344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91726d26-539b-4538-8727-d1e11aa675c7 None admin] RBAC: Authorizing `identity:get_user(user_id=a8d4aca0466d451997a4d39609349c94)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:59.328791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91726d26-539b-4538-8727-d1e11aa675c7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:59.335151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 513/1050] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:56:59 2022] GET /identity/v3/users/a8d4aca0466d451997a4d39609349c94 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:59.336729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4313597-6985-4638-9ac8-5d637295f953 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:59.432724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:59.436590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4313597-6985-4638-9ac8-5d637295f953 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:59.471625 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1120-7f60-4934-96d3-bef228eca034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:59.472244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1120-7f60-4934-96d3-bef228eca034 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:59.472523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1120-7f60-4934-96d3-bef228eca034 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:59.472791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1120-7f60-4934-96d3-bef228eca034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:59.540822 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d1120-7f60-4934-96d3-bef228eca034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:59.542276 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d1120-7f60-4934-96d3-bef228eca034 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:59.638664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:59.643867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 538/1051] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:56:59 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 01:56:59.650419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91726d26-539b-4538-8727-d1e11aa675c7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:59.662622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:56:59.756508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91726d26-539b-4538-8727-d1e11aa675c7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:59.790772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00812ee-b372-45c8-91a7-1c40ffcbc380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:59.791408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00812ee-b372-45c8-91a7-1c40ffcbc380 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:59.791687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00812ee-b372-45c8-91a7-1c40ffcbc380 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:59.791961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00812ee-b372-45c8-91a7-1c40ffcbc380 None admin] PATH_INFO: `/v3/projects/35c14e9135244dab97aefc49f9c9d86e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:59.793157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00812ee-b372-45c8-91a7-1c40ffcbc380 None admin] RBAC: Authorizing `identity:get_project(project_id=35c14e9135244dab97aefc49f9c9d86e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:59.794608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00812ee-b372-45c8-91a7-1c40ffcbc380 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:59.796426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 514/1052] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:56:59 2022] GET /identity/v3/projects/35c14e9135244dab97aefc49f9c9d86e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:56:59.802277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1120-7f60-4934-96d3-bef228eca034 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:56:59.911907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1120-7f60-4934-96d3-bef228eca034 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:56:59.949580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f021400-7668-430a-aa8f-eac57c1c5047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:56:59.950351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f021400-7668-430a-aa8f-eac57c1c5047 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:56:59.950783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f021400-7668-430a-aa8f-eac57c1c5047 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:56:59.951062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f021400-7668-430a-aa8f-eac57c1c5047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:56:59.951884 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f021400-7668-430a-aa8f-eac57c1c5047 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=35c14e9135244dab97aefc49f9c9d86e, user.id=a8d4aca0466d451997a4d39609349c94) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:56:59.952191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f021400-7668-430a-aa8f-eac57c1c5047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:56:59.953621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f021400-7668-430a-aa8f-eac57c1c5047 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:56:59.959643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 539/1053] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:56:59 2022] GET /identity/v3/role_assignments?user.id=a8d4aca0466d451997a4d39609349c94&scope.project.id=35c14e9135244dab97aefc49f9c9d86e&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:00.013008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bae3dd-29fc-4311-bdb2-4ad5c7af9d71 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:00.013188 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bae3dd-29fc-4311-bdb2-4ad5c7af9d71 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:00.013460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bae3dd-29fc-4311-bdb2-4ad5c7af9d71 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:00.015124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 515/1054] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:00.020779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80c596-334b-4371-af9c-d68c6deebd4b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:00.021066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80c596-334b-4371-af9c-d68c6deebd4b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:00.021334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80c596-334b-4371-af9c-d68c6deebd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:00.040513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-5d80c596-334b-4371-af9c-d68c6deebd4b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:00.041720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-5d80c596-334b-4371-af9c-d68c6deebd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:00.107747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:00.117872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 540/1055] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:00.140820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bae3dd-29fc-4311-bdb2-4ad5c7af9d71 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:00.230773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:00.254698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bae3dd-29fc-4311-bdb2-4ad5c7af9d71 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:00.288785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a1df5-a4bb-441b-9266-25fcaed3c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:00.289345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1df5-a4bb-441b-9266-25fcaed3c26b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:00.289624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1df5-a4bb-441b-9266-25fcaed3c26b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:00.289893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1df5-a4bb-441b-9266-25fcaed3c26b None admin] PATH_INFO: `/v3/services/image` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:00.290546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a1df5-a4bb-441b-9266-25fcaed3c26b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:00.291919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a1df5-a4bb-441b-9266-25fcaed3c26b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-832a1df5-a4bb-441b-9266-25fcaed3c26b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:00.300794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:00.301823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:00.302714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 516/1056] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Jul 28 01:57:00 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:57:00.310209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80c596-334b-4371-af9c-d68c6deebd4b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:00.414954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80c596-334b-4371-af9c-d68c6deebd4b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:00.450704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca859d1-2604-4d89-ab14-6ed0addbd34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:00.451672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca859d1-2604-4d89-ab14-6ed0addbd34f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:00.452149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca859d1-2604-4d89-ab14-6ed0addbd34f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:00.452647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca859d1-2604-4d89-ab14-6ed0addbd34f None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:00.453519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca859d1-2604-4d89-ab14-6ed0addbd34f None admin] RBAC: Adding query filter params (name=image) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:00.454015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca859d1-2604-4d89-ab14-6ed0addbd34f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:00.455614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca859d1-2604-4d89-ab14-6ed0addbd34f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:00.461081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 541/1057] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:57:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:00.466635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a1df5-a4bb-441b-9266-25fcaed3c26b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:00.568917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a1df5-a4bb-441b-9266-25fcaed3c26b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:00.603724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee866c84-8add-44d3-8460-98a9582424e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:00.604348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866c84-8add-44d3-8460-98a9582424e7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:00.604633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866c84-8add-44d3-8460-98a9582424e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:00.604910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866c84-8add-44d3-8460-98a9582424e7 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:00.605592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee866c84-8add-44d3-8460-98a9582424e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:00.605900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee866c84-8add-44d3-8460-98a9582424e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:00.607311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee866c84-8add-44d3-8460-98a9582424e7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:00.612424 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 517/1058] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:57:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:00.618740 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca859d1-2604-4d89-ab14-6ed0addbd34f None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:00.681082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:00.724105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca859d1-2604-4d89-ab14-6ed0addbd34f None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:00.758540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c1829-d168-4f46-b7de-25ab365fe78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:00.759236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c1829-d168-4f46-b7de-25ab365fe78a None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:00.759585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c1829-d168-4f46-b7de-25ab365fe78a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:00.759926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c1829-d168-4f46-b7de-25ab365fe78a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:00.760715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c1829-d168-4f46-b7de-25ab365fe78a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:00.762148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c1829-d168-4f46-b7de-25ab365fe78a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:00.786488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 542/1059] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 01:57:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:57:00.829545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9514202-0caa-4ff4-b586-9be18825388f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:00.829847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9514202-0caa-4ff4-b586-9be18825388f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:00.830226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9514202-0caa-4ff4-b586-9be18825388f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:00.831815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 518/1060] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:00.837764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0682faa-32f9-4185-b22a-4c020346d541 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:00.838075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0682faa-32f9-4185-b22a-4c020346d541 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:00.838327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0682faa-32f9-4185-b22a-4c020346d541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:00.857382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d0682faa-32f9-4185-b22a-4c020346d541 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:00.858782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d0682faa-32f9-4185-b22a-4c020346d541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:00.944708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 543/1061] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:00.967220 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9514202-0caa-4ff4-b586-9be18825388f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:00.977006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:01.078704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9514202-0caa-4ff4-b586-9be18825388f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:01.112322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55fa0a-5a40-4301-8744-214cf19aeb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:01.112880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55fa0a-5a40-4301-8744-214cf19aeb32 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:01.113161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55fa0a-5a40-4301-8744-214cf19aeb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:01.113431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55fa0a-5a40-4301-8744-214cf19aeb32 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:01.124525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55fa0a-5a40-4301-8744-214cf19aeb32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ad55fa0a-5a40-4301-8744-214cf19aeb32 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:57:01.129415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:01.130324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:01.131197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 519/1062] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jul 28 01:57:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:01.139704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0682faa-32f9-4185-b22a-4c020346d541 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:01.183042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:01.243842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0682faa-32f9-4185-b22a-4c020346d541 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:01.277757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb572f9-4be7-4527-90d6-c19f4ec4846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:01.278365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb572f9-4be7-4527-90d6-c19f4ec4846e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:01.278672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb572f9-4be7-4527-90d6-c19f4ec4846e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:01.278944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb572f9-4be7-4527-90d6-c19f4ec4846e None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:01.279699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb572f9-4be7-4527-90d6-c19f4ec4846e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:01.279999 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb572f9-4be7-4527-90d6-c19f4ec4846e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:01.281454 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb572f9-4be7-4527-90d6-c19f4ec4846e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:01.291518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 544/1063] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jul 28 01:57:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:01.296963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55fa0a-5a40-4301-8744-214cf19aeb32 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:01.364017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:01.401238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55fa0a-5a40-4301-8744-214cf19aeb32 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:01.437951 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f13cb-8eff-4e14-955a-a8ae6da179fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:01.438624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f13cb-8eff-4e14-955a-a8ae6da179fe None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:01.438902 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f13cb-8eff-4e14-955a-a8ae6da179fe None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:01.439171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f13cb-8eff-4e14-955a-a8ae6da179fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:01.450059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f13cb-8eff-4e14-955a-a8ae6da179fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:01.451522 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f13cb-8eff-4e14-955a-a8ae6da179fe None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b62f13cb-8eff-4e14-955a-a8ae6da179fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:57:01.465910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:01.467128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:01.468030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:57:01.468030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:57:01.468030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:57:01.468030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:01.468030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 520/1064] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:01.474066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb572f9-4be7-4527-90d6-c19f4ec4846e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:01.574391 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb572f9-4be7-4527-90d6-c19f4ec4846e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:01.576186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:01.609453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f5c0-c7a3-4c30-adac-eb69d4be2592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:01.610063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f5c0-c7a3-4c30-adac-eb69d4be2592 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:01.610340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f5c0-c7a3-4c30-adac-eb69d4be2592 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:01.610638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f5c0-c7a3-4c30-adac-eb69d4be2592 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:01.611324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361f5c0-c7a3-4c30-adac-eb69d4be2592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:01.611624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361f5c0-c7a3-4c30-adac-eb69d4be2592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:01.612987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361f5c0-c7a3-4c30-adac-eb69d4be2592 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:01.629654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 545/1065] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:01.631287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f13cb-8eff-4e14-955a-a8ae6da179fe None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:01.733990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f13cb-8eff-4e14-955a-a8ae6da179fe None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:01.751038 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:01.769572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5b9cb-0d5f-40c0-b6cc-166406eaf616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:01.770201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5b9cb-0d5f-40c0-b6cc-166406eaf616 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:01.770505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5b9cb-0d5f-40c0-b6cc-166406eaf616 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:01.770779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5b9cb-0d5f-40c0-b6cc-166406eaf616 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:01.778107 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5b9cb-0d5f-40c0-b6cc-166406eaf616 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:01.779569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5b9cb-0d5f-40c0-b6cc-166406eaf616 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-08d5b9cb-0d5f-40c0-b6cc-166406eaf616 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:57:01.790589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:01.791503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:01.792425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:01.792425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:01.792425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:57:01.792425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:57:01.792425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:57:01.792425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:57:01.792425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:57:01.792425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:57:01.792425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:57:01.792425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:01.794508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 521/1066] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jul 28 01:57:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:01.797795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f5c0-c7a3-4c30-adac-eb69d4be2592 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:01.909906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f5c0-c7a3-4c30-adac-eb69d4be2592 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:01.947576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dad5f-a0e3-4492-bc64-438e9e00f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:01.948189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dad5f-a0e3-4492-bc64-438e9e00f2ea None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:01.948475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dad5f-a0e3-4492-bc64-438e9e00f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:01.948749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dad5f-a0e3-4492-bc64-438e9e00f2ea None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:01.949552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dad5f-a0e3-4492-bc64-438e9e00f2ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:01.949859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dad5f-a0e3-4492-bc64-438e9e00f2ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:01.951341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dad5f-a0e3-4492-bc64-438e9e00f2ea None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:01.954634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd50899-96cb-4d10-b5ab-c584b09a960d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:01.954634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd50899-96cb-4d10-b5ab-c584b09a960d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:01.954634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd50899-96cb-4d10-b5ab-c584b09a960d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:01.955928 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 522/1067] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:57:01.960567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c07fe-1a6f-4485-bdc3-a23613c676a6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:01.960850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c07fe-1a6f-4485-bdc3-a23613c676a6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:01.961131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c07fe-1a6f-4485-bdc3-a23613c676a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:01.969901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 546/1068] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jul 28 01:57:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:01.975456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dad5f-a0e3-4492-bc64-438e9e00f2ea None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:01.980760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b99c07fe-1a6f-4485-bdc3-a23613c676a6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:01.981952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b99c07fe-1a6f-4485-bdc3-a23613c676a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:01.999385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:02.056742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 523/1069] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:57:02.078614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c07fe-1a6f-4485-bdc3-a23613c676a6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:02.081387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dad5f-a0e3-4492-bc64-438e9e00f2ea None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:02.117499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02abea-54ff-487a-a46c-38ea2c41c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:02.118373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02abea-54ff-487a-a46c-38ea2c41c229 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.118835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02abea-54ff-487a-a46c-38ea2c41c229 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.119108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02abea-54ff-487a-a46c-38ea2c41c229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.130705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02abea-54ff-487a-a46c-38ea2c41c229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:02.132434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02abea-54ff-487a-a46c-38ea2c41c229 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-be02abea-54ff-487a-a46c-38ea2c41c229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:57:02.146937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:02.147801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:02.149485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:57:02.149485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:57:02.149485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:57:02.149485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:57:02.149485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 547/1070] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:57:02.153531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02abea-54ff-487a-a46c-38ea2c41c229 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:02.186765 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c07fe-1a6f-4485-bdc3-a23613c676a6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:02.200449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:02.229723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf4ad0-2cca-47db-8b4f-1bad953f3472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:02.230361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf4ad0-2cca-47db-8b4f-1bad953f3472 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.230686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf4ad0-2cca-47db-8b4f-1bad953f3472 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.231010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf4ad0-2cca-47db-8b4f-1bad953f3472 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.233548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:02.242293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf4ad0-2cca-47db-8b4f-1bad953f3472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7acf4ad0-2cca-47db-8b4f-1bad953f3472 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:57:02.247222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:02.248211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:02.249827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 524/1071] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:57:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:57:02.254412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf4ad0-2cca-47db-8b4f-1bad953f3472 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:02.267275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02abea-54ff-487a-a46c-38ea2c41c229 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:02.304519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6e74-aa92-46cf-bc3e-1fa215fe95e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:02.305133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6e74-aa92-46cf-bc3e-1fa215fe95e5 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.305415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6e74-aa92-46cf-bc3e-1fa215fe95e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.305688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6e74-aa92-46cf-bc3e-1fa215fe95e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.306381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6e74-aa92-46cf-bc3e-1fa215fe95e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:02.306716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6e74-aa92-46cf-bc3e-1fa215fe95e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:02.308092 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6e74-aa92-46cf-bc3e-1fa215fe95e5 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:02.325861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 548/1072] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:02.326904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6e74-aa92-46cf-bc3e-1fa215fe95e5 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:02.365129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf4ad0-2cca-47db-8b4f-1bad953f3472 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:02.401718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8a6d7-f5ec-42d6-8261-bec803317c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:02.402335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8a6d7-f5ec-42d6-8261-bec803317c93 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.402643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8a6d7-f5ec-42d6-8261-bec803317c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.402913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8a6d7-f5ec-42d6-8261-bec803317c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.403634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8a6d7-f5ec-42d6-8261-bec803317c93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:02.403939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8a6d7-f5ec-42d6-8261-bec803317c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:02.405309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8a6d7-f5ec-42d6-8261-bec803317c93 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:02.418897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 525/1073] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:57:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:02.420089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8a6d7-f5ec-42d6-8261-bec803317c93 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:02.442119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6e74-aa92-46cf-bc3e-1fa215fe95e5 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:02.451520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:02.474298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:02.481188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802974bb-8f2a-4b60-94e1-7100cab1f730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:02.481946 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802974bb-8f2a-4b60-94e1-7100cab1f730 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.482225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802974bb-8f2a-4b60-94e1-7100cab1f730 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.482526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802974bb-8f2a-4b60-94e1-7100cab1f730 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.490131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802974bb-8f2a-4b60-94e1-7100cab1f730 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:02.491884 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802974bb-8f2a-4b60-94e1-7100cab1f730 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-802974bb-8f2a-4b60-94e1-7100cab1f730 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:57:02.503777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:02.504870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:02.505984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:57:02.505984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:57:02.505984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:57:02.505984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:57:02.505984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:57:02.505984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:57:02.505984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:57:02.505984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:57:02.505984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 549/1074] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:02.510608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802974bb-8f2a-4b60-94e1-7100cab1f730 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:02.529873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8a6d7-f5ec-42d6-8261-bec803317c93 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:02.566796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634c091-6a83-4461-b64d-134c94042819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:02.567460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634c091-6a83-4461-b64d-134c94042819 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.567744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634c091-6a83-4461-b64d-134c94042819 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.568549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634c091-6a83-4461-b64d-134c94042819 None admin] PATH_INFO: `/v3/users/a8d4aca0466d451997a4d39609349c94` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.570595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634c091-6a83-4461-b64d-134c94042819 None admin] RBAC: Authorizing `identity:get_user(user_id=a8d4aca0466d451997a4d39609349c94)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:02.572730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634c091-6a83-4461-b64d-134c94042819 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:02.575070 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 526/1075] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:02 2022] GET /identity/v3/users/a8d4aca0466d451997a4d39609349c94 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:02.580429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634c091-6a83-4461-b64d-134c94042819 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:02.619031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802974bb-8f2a-4b60-94e1-7100cab1f730 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:02.653867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81159c57-0ca9-4497-a277-99d1f14edad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:02.654509 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81159c57-0ca9-4497-a277-99d1f14edad1 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.654798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81159c57-0ca9-4497-a277-99d1f14edad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.655077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81159c57-0ca9-4497-a277-99d1f14edad1 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.655841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81159c57-0ca9-4497-a277-99d1f14edad1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:02.656150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81159c57-0ca9-4497-a277-99d1f14edad1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:02.657594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81159c57-0ca9-4497-a277-99d1f14edad1 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:02.669682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 550/1076] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:57:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:02.675702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81159c57-0ca9-4497-a277-99d1f14edad1 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:02.697457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:02.700386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634c091-6a83-4461-b64d-134c94042819 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:02.736356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa7005-052e-428b-a568-38c4b6cade29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:02.736996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa7005-052e-428b-a568-38c4b6cade29 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.737276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa7005-052e-428b-a568-38c4b6cade29 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.737451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:02.737568 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa7005-052e-428b-a568-38c4b6cade29 None admin] PATH_INFO: `/v3/projects/35c14e9135244dab97aefc49f9c9d86e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.738712 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa7005-052e-428b-a568-38c4b6cade29 None admin] RBAC: Authorizing `identity:get_project(project_id=35c14e9135244dab97aefc49f9c9d86e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:02.740137 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa7005-052e-428b-a568-38c4b6cade29 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:02.746927 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 527/1077] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:02 2022] GET /identity/v3/projects/35c14e9135244dab97aefc49f9c9d86e => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:02.747562 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa7005-052e-428b-a568-38c4b6cade29 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:02.790913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81159c57-0ca9-4497-a277-99d1f14edad1 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:02.828818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19648354-8cd8-4461-a4ae-4646afa2d9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:02.829484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648354-8cd8-4461-a4ae-4646afa2d9eb None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.829766 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648354-8cd8-4461-a4ae-4646afa2d9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.830037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648354-8cd8-4461-a4ae-4646afa2d9eb None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/b9f911e716994f1f9d4705216ee0f3a5/roles/05383c83ec49434b82842b6b3c0c4b38` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.832319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19648354-8cd8-4461-a4ae-4646afa2d9eb None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=b9f911e716994f1f9d4705216ee0f3a5, role_id=05383c83ec49434b82842b6b3c0c4b38)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:02.833744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19648354-8cd8-4461-a4ae-4646afa2d9eb None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:02.847456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 551/1078] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:57:02 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/b9f911e716994f1f9d4705216ee0f3a5/roles/05383c83ec49434b82842b6b3c0c4b38 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 01:57:02.848672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878703-bfe9-4fab-b57d-3e44ee8d05b4 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.848953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878703-bfe9-4fab-b57d-3e44ee8d05b4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.849222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878703-bfe9-4fab-b57d-3e44ee8d05b4 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.850488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 552/1079] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:02.855482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa7005-052e-428b-a568-38c4b6cade29 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:02.856057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f1fbc-27e3-4b75-916e-9d2cfacddd6c None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.856342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f1fbc-27e3-4b75-916e-9d2cfacddd6c None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.856618 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f1fbc-27e3-4b75-916e-9d2cfacddd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.881793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d46f1fbc-27e3-4b75-916e-9d2cfacddd6c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:02.883714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d46f1fbc-27e3-4b75-916e-9d2cfacddd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:02.903754 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c419c-7671-4f85-a9f8-7f0bf341d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:02.904452 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c419c-7671-4f85-a9f8-7f0bf341d784 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:02.904732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c419c-7671-4f85-a9f8-7f0bf341d784 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:02.905002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c419c-7671-4f85-a9f8-7f0bf341d784 None admin] PATH_INFO: `/v3/projects/35c14e9135244dab97aefc49f9c9d86e/users/a8d4aca0466d451997a4d39609349c94/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:02.907745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c419c-7671-4f85-a9f8-7f0bf341d784 None admin] RBAC: Authorizing `identity:create_grant(project_id=35c14e9135244dab97aefc49f9c9d86e, user_id=a8d4aca0466d451997a4d39609349c94, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:02.909204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c419c-7671-4f85-a9f8-7f0bf341d784 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:02.923235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 528/1080] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:57:02 2022] PUT /identity/v3/projects/35c14e9135244dab97aefc49f9c9d86e/users/a8d4aca0466d451997a4d39609349c94/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 01:57:02.964289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 553/1081] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:57:02.987139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c419c-7671-4f85-a9f8-7f0bf341d784 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:03.021598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:03.106805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c419c-7671-4f85-a9f8-7f0bf341d784 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:03.142574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31c7db-f9c0-4f71-babc-badffd03834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:03.143199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31c7db-f9c0-4f71-babc-badffd03834a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:03.143571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31c7db-f9c0-4f71-babc-badffd03834a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:03.143881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31c7db-f9c0-4f71-babc-badffd03834a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:03.213070 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31c7db-f9c0-4f71-babc-badffd03834a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:03.214601 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31c7db-f9c0-4f71-babc-badffd03834a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:03.240580 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:03.315965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 529/1082] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:57:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 01:57:03.322926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f1fbc-27e3-4b75-916e-9d2cfacddd6c None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:03.369973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:03.430549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f1fbc-27e3-4b75-916e-9d2cfacddd6c None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:03.465565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7b018-2084-4088-8693-0d36b18c295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:03.466119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7b018-2084-4088-8693-0d36b18c295e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:03.466401 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7b018-2084-4088-8693-0d36b18c295e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:03.466703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7b018-2084-4088-8693-0d36b18c295e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:03.477146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7b018-2084-4088-8693-0d36b18c295e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:03.478624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7b018-2084-4088-8693-0d36b18c295e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-b8e7b018-2084-4088-8693-0d36b18c295e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:57:03.493697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:03.494693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:03.495586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:57:03.495586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:57:03.495586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:57:03.495586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:57:03.498763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 554/1083] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:03.500825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31c7db-f9c0-4f71-babc-badffd03834a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:03.604518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31c7db-f9c0-4f71-babc-badffd03834a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:03.630882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:03.641148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e5605-fc26-47f9-9108-cb83c800de5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:03.641764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5605-fc26-47f9-9108-cb83c800de5a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:03.642040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5605-fc26-47f9-9108-cb83c800de5a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:03.642308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5605-fc26-47f9-9108-cb83c800de5a None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:03.643028 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e5605-fc26-47f9-9108-cb83c800de5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:03.643330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e5605-fc26-47f9-9108-cb83c800de5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:03.644823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e5605-fc26-47f9-9108-cb83c800de5a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:03.662469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 530/1084] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:04.892402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddfc68-3d7e-4a9b-af34-1b9d60c48e7e None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:04.892858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddfc68-3d7e-4a9b-af34-1b9d60c48e7e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:04.892964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddfc68-3d7e-4a9b-af34-1b9d60c48e7e None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:04.894301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 555/1085] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:04.900359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465814cd-4b49-4e0e-889e-6fe45aab3586 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:04.900762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465814cd-4b49-4e0e-889e-6fe45aab3586 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:04.900909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465814cd-4b49-4e0e-889e-6fe45aab3586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:04.918712 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-465814cd-4b49-4e0e-889e-6fe45aab3586 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:04.919895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-465814cd-4b49-4e0e-889e-6fe45aab3586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:04.938215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d7ca9-bcd8-419d-bfb7-0f8ded2e3393 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:04.938532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d7ca9-bcd8-419d-bfb7-0f8ded2e3393 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:04.938809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d7ca9-bcd8-419d-bfb7-0f8ded2e3393 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:04.940159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 556/1086] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 01:57:04.945713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c885-6985-4824-ae3f-9ffbd6416cfc None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:04.945990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c885-6985-4824-ae3f-9ffbd6416cfc None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:04.946262 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c885-6985-4824-ae3f-9ffbd6416cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:04.964590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-13a7c885-6985-4824-ae3f-9ffbd6416cfc None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:04.965772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-13a7c885-6985-4824-ae3f-9ffbd6416cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:04.987211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 531/1087] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:05.009786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465814cd-4b49-4e0e-889e-6fe45aab3586 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.033007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 557/1088] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:57:05.055207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c885-6985-4824-ae3f-9ffbd6416cfc None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.079196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:05.106670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465814cd-4b49-4e0e-889e-6fe45aab3586 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.122686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:05.141861 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6220c-2aef-4b5d-9751-50edebfe5951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.142423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6220c-2aef-4b5d-9751-50edebfe5951 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.142729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6220c-2aef-4b5d-9751-50edebfe5951 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.143004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6220c-2aef-4b5d-9751-50edebfe5951 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.153708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6220c-2aef-4b5d-9751-50edebfe5951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:57:05.153831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c885-6985-4824-ae3f-9ffbd6416cfc None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-83c6220c-2aef-4b5d-9751-50edebfe5951 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:57:05.158519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:05.159634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:05.160496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 532/1089] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:57:05.165693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6220c-2aef-4b5d-9751-50edebfe5951 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.187566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba8c20-37fb-40ee-9db6-06efb8e3f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.188199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba8c20-37fb-40ee-9db6-06efb8e3f1eb None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.188479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba8c20-37fb-40ee-9db6-06efb8e3f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.188756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba8c20-37fb-40ee-9db6-06efb8e3f1eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.199747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba8c20-37fb-40ee-9db6-06efb8e3f1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-51ba8c20-37fb-40ee-9db6-06efb8e3f1eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:57:05.204661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:05.205699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:57:05.206582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 558/1090] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:05.211765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba8c20-37fb-40ee-9db6-06efb8e3f1eb None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.267567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6220c-2aef-4b5d-9751-50edebfe5951 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.294523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:05.301455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c92ae2-2f6d-49d5-bd3e-fc63fbf0c18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.302082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c92ae2-2f6d-49d5-bd3e-fc63fbf0c18c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.302379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c92ae2-2f6d-49d5-bd3e-fc63fbf0c18c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.302682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c92ae2-2f6d-49d5-bd3e-fc63fbf0c18c None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.303396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c92ae2-2f6d-49d5-bd3e-fc63fbf0c18c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:05.303700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c92ae2-2f6d-49d5-bd3e-fc63fbf0c18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:05.305598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c92ae2-2f6d-49d5-bd3e-fc63fbf0c18c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:05.310940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba8c20-37fb-40ee-9db6-06efb8e3f1eb None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.313518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 533/1091] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:05.319582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c92ae2-2f6d-49d5-bd3e-fc63fbf0c18c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.346302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54f2c-1f4e-4599-8cd1-ab534f8e045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.346993 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54f2c-1f4e-4599-8cd1-ab534f8e045d None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.347270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54f2c-1f4e-4599-8cd1-ab534f8e045d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.347538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54f2c-1f4e-4599-8cd1-ab534f8e045d None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.348249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d54f2c-1f4e-4599-8cd1-ab534f8e045d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:05.348548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d54f2c-1f4e-4599-8cd1-ab534f8e045d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:05.349905 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d54f2c-1f4e-4599-8cd1-ab534f8e045d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:05.357814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 559/1092] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:05.358676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:05.363852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54f2c-1f4e-4599-8cd1-ab534f8e045d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.420526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c92ae2-2f6d-49d5-bd3e-fc63fbf0c18c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.453983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4e012-3909-4148-ba91-9aa8ab0440c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.454642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4e012-3909-4148-ba91-9aa8ab0440c1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.454921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4e012-3909-4148-ba91-9aa8ab0440c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.455191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4e012-3909-4148-ba91-9aa8ab0440c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.461814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54f2c-1f4e-4599-8cd1-ab534f8e045d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.465470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4e012-3909-4148-ba91-9aa8ab0440c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:05.466942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4e012-3909-4148-ba91-9aa8ab0440c1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-efc4e012-3909-4148-ba91-9aa8ab0440c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:57:05.480650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:05.481533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:05.482431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:57:05.482431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:57:05.482431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:57:05.482431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:05.482431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 534/1093] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:57:05.487465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4e012-3909-4148-ba91-9aa8ab0440c1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.495647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2abc10-10b2-4e5d-ba56-55d83145b0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.496280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2abc10-10b2-4e5d-ba56-55d83145b0ec None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.496557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2abc10-10b2-4e5d-ba56-55d83145b0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.496826 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2abc10-10b2-4e5d-ba56-55d83145b0ec None admin] PATH_INFO: `/v3/users/a8d4aca0466d451997a4d39609349c94` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.497989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2abc10-10b2-4e5d-ba56-55d83145b0ec None admin] RBAC: Authorizing `identity:get_user(user_id=a8d4aca0466d451997a4d39609349c94)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:05.499449 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2abc10-10b2-4e5d-ba56-55d83145b0ec None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:05.501042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 560/1094] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/users/a8d4aca0466d451997a4d39609349c94 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:05.506751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2abc10-10b2-4e5d-ba56-55d83145b0ec None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.522478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:05.578579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:05.589134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4e012-3909-4148-ba91-9aa8ab0440c1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.607415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2abc10-10b2-4e5d-ba56-55d83145b0ec None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.623206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b428d-4db7-4f5f-bd72-3a44558dc884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.623818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b428d-4db7-4f5f-bd72-3a44558dc884 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.624092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b428d-4db7-4f5f-bd72-3a44558dc884 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.624360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b428d-4db7-4f5f-bd72-3a44558dc884 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.625040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b428d-4db7-4f5f-bd72-3a44558dc884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:05.625337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b428d-4db7-4f5f-bd72-3a44558dc884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:05.626710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b428d-4db7-4f5f-bd72-3a44558dc884 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:05.638240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 535/1095] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:05.640552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb86f4b-bbea-41d7-9a2b-9cac7de1d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.641154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb86f4b-bbea-41d7-9a2b-9cac7de1d2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.641428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb86f4b-bbea-41d7-9a2b-9cac7de1d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.641695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb86f4b-bbea-41d7-9a2b-9cac7de1d2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.643831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b428d-4db7-4f5f-bd72-3a44558dc884 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.709313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb86f4b-bbea-41d7-9a2b-9cac7de1d2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:05.710734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb86f4b-bbea-41d7-9a2b-9cac7de1d2e4 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:05.724788 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:05.742701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b428d-4db7-4f5f-bd72-3a44558dc884 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.775145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8649-59b3-490b-9a94-f14010666118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.775761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8649-59b3-490b-9a94-f14010666118 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.776037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8649-59b3-490b-9a94-f14010666118 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.776303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8649-59b3-490b-9a94-f14010666118 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.783100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac8649-59b3-490b-9a94-f14010666118 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:05.784509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac8649-59b3-490b-9a94-f14010666118 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e1ac8649-59b3-490b-9a94-f14010666118 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:57:05.796253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:05.797235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:05.798665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 536/1096] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:57:05.803035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8649-59b3-490b-9a94-f14010666118 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.811571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 561/1097] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 01:57:05.813885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb86f4b-bbea-41d7-9a2b-9cac7de1d2e4 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.815376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:05.908975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8649-59b3-490b-9a94-f14010666118 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.909939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb86f4b-bbea-41d7-9a2b-9cac7de1d2e4 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:05.924468 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:05.943500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c554dc-7edb-4574-8c81-4be138030b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.944113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c554dc-7edb-4574-8c81-4be138030b96 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.944387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c554dc-7edb-4574-8c81-4be138030b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.944543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c0884-30b3-4956-8f0b-3da62aea39b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:05.944650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c554dc-7edb-4574-8c81-4be138030b96 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.945189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c0884-30b3-4956-8f0b-3da62aea39b3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:05.945458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c554dc-7edb-4574-8c81-4be138030b96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:05.945551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c0884-30b3-4956-8f0b-3da62aea39b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:05.945725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c0884-30b3-4956-8f0b-3da62aea39b3 None admin] PATH_INFO: `/v3/projects/35c14e9135244dab97aefc49f9c9d86e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:05.945816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c554dc-7edb-4574-8c81-4be138030b96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:05.946912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c0884-30b3-4956-8f0b-3da62aea39b3 None admin] RBAC: Authorizing `identity:get_project(project_id=35c14e9135244dab97aefc49f9c9d86e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:05.947197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c554dc-7edb-4574-8c81-4be138030b96 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:05.948345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c0884-30b3-4956-8f0b-3da62aea39b3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:05.949991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 562/1098] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/projects/35c14e9135244dab97aefc49f9c9d86e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:05.955900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c0884-30b3-4956-8f0b-3da62aea39b3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:05.969465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 537/1099] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:05.970365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c554dc-7edb-4574-8c81-4be138030b96 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:06.033500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:06.051513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c0884-30b3-4956-8f0b-3da62aea39b3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:06.067323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c554dc-7edb-4574-8c81-4be138030b96 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:06.083813 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a9bf5-6afc-45bb-aebc-8f016691fb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:06.084407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9bf5-6afc-45bb-aebc-8f016691fb8d None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:06.084683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9bf5-6afc-45bb-aebc-8f016691fb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:06.084951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9bf5-6afc-45bb-aebc-8f016691fb8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:06.086254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a9bf5-6afc-45bb-aebc-8f016691fb8d None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=35c14e9135244dab97aefc49f9c9d86e, user.id=a8d4aca0466d451997a4d39609349c94) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:06.086597 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a9bf5-6afc-45bb-aebc-8f016691fb8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:06.088009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a9bf5-6afc-45bb-aebc-8f016691fb8d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:06.093541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 563/1100] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/role_assignments?user.id=a8d4aca0466d451997a4d39609349c94&scope.project.id=35c14e9135244dab97aefc49f9c9d86e&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:06.100713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29d26e-1593-4767-80be-924aade5ea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:06.101894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29d26e-1593-4767-80be-924aade5ea1d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:06.102176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29d26e-1593-4767-80be-924aade5ea1d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:06.102465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29d26e-1593-4767-80be-924aade5ea1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:06.175244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29d26e-1593-4767-80be-924aade5ea1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:06.176708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29d26e-1593-4767-80be-924aade5ea1d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:06.248156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:06.283988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 538/1101] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:57:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 01:57:06.290632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a9bf5-6afc-45bb-aebc-8f016691fb8d None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:06.341195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:06.395558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a9bf5-6afc-45bb-aebc-8f016691fb8d None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:06.429605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab7149-cd04-42c8-99ef-314328f8de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:06.430233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab7149-cd04-42c8-99ef-314328f8de21 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:06.430831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab7149-cd04-42c8-99ef-314328f8de21 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:06.431109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab7149-cd04-42c8-99ef-314328f8de21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:06.442024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab7149-cd04-42c8-99ef-314328f8de21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:06.443502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab7149-cd04-42c8-99ef-314328f8de21 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-4eab7149-cd04-42c8-99ef-314328f8de21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:57:06.457896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:06.458913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:06.459806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:57:06.459806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:57:06.459806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:57:06.459806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:57:06.459806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 564/1102] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:06.465299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29d26e-1593-4767-80be-924aade5ea1d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:06.560940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29d26e-1593-4767-80be-924aade5ea1d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:06.602310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143483b-3f70-4134-8811-978d4a32a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:06.602956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143483b-3f70-4134-8811-978d4a32a313 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:06.603232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143483b-3f70-4134-8811-978d4a32a313 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:06.603501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143483b-3f70-4134-8811-978d4a32a313 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:06.604184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143483b-3f70-4134-8811-978d4a32a313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:06.604485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143483b-3f70-4134-8811-978d4a32a313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:06.605850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143483b-3f70-4134-8811-978d4a32a313 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:06.616961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 539/1103] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:06.622581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab7149-cd04-42c8-99ef-314328f8de21 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:06.718269 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:06.722385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab7149-cd04-42c8-99ef-314328f8de21 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:06.755744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c46cb6-6035-4562-9579-211688ce5316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:06.756371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c46cb6-6035-4562-9579-211688ce5316 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:06.756646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c46cb6-6035-4562-9579-211688ce5316 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:06.756915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c46cb6-6035-4562-9579-211688ce5316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:06.764087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c46cb6-6035-4562-9579-211688ce5316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:06.765519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c46cb6-6035-4562-9579-211688ce5316 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-97c46cb6-6035-4562-9579-211688ce5316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:57:06.776663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:06.777703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:06.778692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:57:06.778692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:57:06.778692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:57:06.778692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:57:06.778692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:57:06.778692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:57:06.778692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:57:06.778692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:57:06.778692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 565/1104] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:57:06.783622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143483b-3f70-4134-8811-978d4a32a313 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:06.811852 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:06.883685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143483b-3f70-4134-8811-978d4a32a313 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:06.915786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469104d-88f4-4bc1-932c-d181aba98856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:06.916393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469104d-88f4-4bc1-932c-d181aba98856 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:06.916669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469104d-88f4-4bc1-932c-d181aba98856 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:06.916939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469104d-88f4-4bc1-932c-d181aba98856 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:06.917677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469104d-88f4-4bc1-932c-d181aba98856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:06.917982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469104d-88f4-4bc1-932c-d181aba98856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:06.919432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469104d-88f4-4bc1-932c-d181aba98856 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:06.931510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 540/1105] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:06.937541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c46cb6-6035-4562-9579-211688ce5316 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:07.036179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c46cb6-6035-4562-9579-211688ce5316 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:07.068446 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492f597-03e1-4796-a2d5-40340c19a0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:07.068977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492f597-03e1-4796-a2d5-40340c19a0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:07.069249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492f597-03e1-4796-a2d5-40340c19a0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:07.069514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492f597-03e1-4796-a2d5-40340c19a0f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:07.070356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492f597-03e1-4796-a2d5-40340c19a0f6 None admin] RBAC: Adding query filter params (role.id=05383c83ec49434b82842b6b3c0c4b38, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=b9f911e716994f1f9d4705216ee0f3a5) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:07.070690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492f597-03e1-4796-a2d5-40340c19a0f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:07.072111 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492f597-03e1-4796-a2d5-40340c19a0f6 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:07.077688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 566/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:57:06 2022] GET /identity/v3/role_assignments?user.id=b9f911e716994f1f9d4705216ee0f3a5&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=05383c83ec49434b82842b6b3c0c4b38 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:08.114232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28f54-2b6b-4324-839f-4b45fd1c0928 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:08.114814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28f54-2b6b-4324-839f-4b45fd1c0928 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:08.114814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28f54-2b6b-4324-839f-4b45fd1c0928 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:08.116165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 541/1107] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:08.121811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d35f-67ad-4d17-af82-f0320fb19dc2 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:08.122223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d35f-67ad-4d17-af82-f0320fb19dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:08.122381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d35f-67ad-4d17-af82-f0320fb19dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:08.140252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9868d35f-67ad-4d17-af82-f0320fb19dc2 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:08.141991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9868d35f-67ad-4d17-af82-f0320fb19dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:08.160266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:08.213448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 567/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:08.246626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28f54-2b6b-4324-839f-4b45fd1c0928 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:08.331833 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:08.347232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28f54-2b6b-4324-839f-4b45fd1c0928 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:08.380339 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5d57d-3f26-4286-870c-f04b4d0efbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:08.380963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5d57d-3f26-4286-870c-f04b4d0efbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:08.381241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5d57d-3f26-4286-870c-f04b4d0efbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:08.381512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5d57d-3f26-4286-870c-f04b4d0efbb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:08.382670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5d57d-3f26-4286-870c-f04b4d0efbb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:08.384092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5d57d-3f26-4286-870c-f04b4d0efbb0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:08.385672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 542/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:57:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:08.391490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868d35f-67ad-4d17-af82-f0320fb19dc2 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:08.489355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868d35f-67ad-4d17-af82-f0320fb19dc2 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:08.521713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4887c-ad7f-4181-b105-65f8fd3e20b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:08.522323 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4887c-ad7f-4181-b105-65f8fd3e20b5 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:08.522634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4887c-ad7f-4181-b105-65f8fd3e20b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:08.523444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4887c-ad7f-4181-b105-65f8fd3e20b5 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:08.524122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4887c-ad7f-4181-b105-65f8fd3e20b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:08.525562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4887c-ad7f-4181-b105-65f8fd3e20b5 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:08.546042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 568/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:57:08 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:57:10.531917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11172cfa-c32f-46f2-9955-dd3210d91614 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:10.532441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11172cfa-c32f-46f2-9955-dd3210d91614 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:10.532441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11172cfa-c32f-46f2-9955-dd3210d91614 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:10.533796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 543/1111] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:10.539342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9963c0-c546-49ef-87b4-0d9ae3c37b77 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:10.539757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9963c0-c546-49ef-87b4-0d9ae3c37b77 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:10.539889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9963c0-c546-49ef-87b4-0d9ae3c37b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:10.557685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4f9963c0-c546-49ef-87b4-0d9ae3c37b77 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:10.558912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4f9963c0-c546-49ef-87b4-0d9ae3c37b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:10.560824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:10.627709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 569/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:10.651555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11172cfa-c32f-46f2-9955-dd3210d91614 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:10.751406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11172cfa-c32f-46f2-9955-dd3210d91614 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:10.785718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8d341-3d40-4bfd-b9b0-559c27959d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:10.786330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8d341-3d40-4bfd-b9b0-559c27959d45 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:10.787409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8d341-3d40-4bfd-b9b0-559c27959d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:10.787682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8d341-3d40-4bfd-b9b0-559c27959d45 None admin] PATH_INFO: `/v3/roles/42afac3d251b45ed822081a66ad20d6d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:10.789729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8d341-3d40-4bfd-b9b0-559c27959d45 None admin] RBAC: Authorizing `identity:get_role(role_id=42afac3d251b45ed822081a66ad20d6d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:10.792037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8d341-3d40-4bfd-b9b0-559c27959d45 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:10.792661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 544/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:10 2022] GET /identity/v3/roles/42afac3d251b45ed822081a66ad20d6d => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:10.798500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9963c0-c546-49ef-87b4-0d9ae3c37b77 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:10.894905 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9963c0-c546-49ef-87b4-0d9ae3c37b77 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:10.927354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190b9b6-ce30-445a-8d72-b576e05c0916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:10.927976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b9b6-ce30-445a-8d72-b576e05c0916 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:10.928248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b9b6-ce30-445a-8d72-b576e05c0916 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:10.928517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b9b6-ce30-445a-8d72-b576e05c0916 None admin] PATH_INFO: `/v3/users/cbbb0d8502d64d9eb879e5f4a5f6fc28` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:10.935567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:10.942814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190b9b6-ce30-445a-8d72-b576e05c0916 None admin] RBAC: Authorizing `identity:get_user(user_id=cbbb0d8502d64d9eb879e5f4a5f6fc28)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:10.944255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190b9b6-ce30-445a-8d72-b576e05c0916 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:10.947121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 570/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:10 2022] GET /identity/v3/users/cbbb0d8502d64d9eb879e5f4a5f6fc28 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:10.952813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8d341-3d40-4bfd-b9b0-559c27959d45 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:10.977652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:11.049109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8d341-3d40-4bfd-b9b0-559c27959d45 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:11.082280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6193c-3e85-4129-aa58-4f4d3e0154f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:11.082901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6193c-3e85-4129-aa58-4f4d3e0154f2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:11.083176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6193c-3e85-4129-aa58-4f4d3e0154f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:11.083443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6193c-3e85-4129-aa58-4f4d3e0154f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:11.150703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6193c-3e85-4129-aa58-4f4d3e0154f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:11.153854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6193c-3e85-4129-aa58-4f4d3e0154f2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:11.179779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:11.251946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 545/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:57:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:57:11.258521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190b9b6-ce30-445a-8d72-b576e05c0916 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:11.363720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190b9b6-ce30-445a-8d72-b576e05c0916 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:11.397596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bba29-0927-4ca1-99dd-0b36fa4c5fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:11.398221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bba29-0927-4ca1-99dd-0b36fa4c5fba None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:11.398525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bba29-0927-4ca1-99dd-0b36fa4c5fba None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:11.398799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bba29-0927-4ca1-99dd-0b36fa4c5fba None admin] PATH_INFO: `/v3/projects/35c14e9135244dab97aefc49f9c9d86e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:11.399941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bba29-0927-4ca1-99dd-0b36fa4c5fba None admin] RBAC: Authorizing `identity:get_project(project_id=35c14e9135244dab97aefc49f9c9d86e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:11.401373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bba29-0927-4ca1-99dd-0b36fa4c5fba None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:11.403051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 571/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:11 2022] GET /identity/v3/projects/35c14e9135244dab97aefc49f9c9d86e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:11.409137 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6193c-3e85-4129-aa58-4f4d3e0154f2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:11.513549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6193c-3e85-4129-aa58-4f4d3e0154f2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:11.535633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:11.546184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec484740-23cb-49ec-a8a1-e48edb369e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:11.546815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec484740-23cb-49ec-a8a1-e48edb369e6d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:11.547090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec484740-23cb-49ec-a8a1-e48edb369e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:11.547357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec484740-23cb-49ec-a8a1-e48edb369e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:11.548128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec484740-23cb-49ec-a8a1-e48edb369e6d None admin] RBAC: Adding query filter params (role.id=42afac3d251b45ed822081a66ad20d6d, scope.project.id=35c14e9135244dab97aefc49f9c9d86e, user.id=cbbb0d8502d64d9eb879e5f4a5f6fc28) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:11.548433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec484740-23cb-49ec-a8a1-e48edb369e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:11.549834 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec484740-23cb-49ec-a8a1-e48edb369e6d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:11.555696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 546/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:57:11 2022] GET /identity/v3/role_assignments?user.id=cbbb0d8502d64d9eb879e5f4a5f6fc28&scope.project.id=35c14e9135244dab97aefc49f9c9d86e&role.id=42afac3d251b45ed822081a66ad20d6d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:13.532967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb81c-3fe8-47d6-a881-a27454ee6a44 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:13.533521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb81c-3fe8-47d6-a881-a27454ee6a44 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:13.533521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb81c-3fe8-47d6-a881-a27454ee6a44 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:13.534908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 572/1118] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:13.540408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837f187-6530-4d85-89cf-7e078a4fd49c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:13.540901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837f187-6530-4d85-89cf-7e078a4fd49c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:13.540994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837f187-6530-4d85-89cf-7e078a4fd49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:13.559511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c837f187-6530-4d85-89cf-7e078a4fd49c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:13.560694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c837f187-6530-4d85-89cf-7e078a4fd49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:13.630476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 547/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:13.650551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fb81c-3fe8-47d6-a881-a27454ee6a44 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:13.714360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:13.756457 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fb81c-3fe8-47d6-a881-a27454ee6a44 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:13.790963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe77d6-7215-4f88-9268-c5a27d745d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:13.791526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe77d6-7215-4f88-9268-c5a27d745d83 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:13.791836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe77d6-7215-4f88-9268-c5a27d745d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:13.792107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe77d6-7215-4f88-9268-c5a27d745d83 None admin] PATH_INFO: `/v3/roles/42afac3d251b45ed822081a66ad20d6d` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:13.793548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe77d6-7215-4f88-9268-c5a27d745d83 None admin] RBAC: Authorizing `identity:get_role(role_id=42afac3d251b45ed822081a66ad20d6d)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:13.794956 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe77d6-7215-4f88-9268-c5a27d745d83 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:13.796286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 573/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:13 2022] GET /identity/v3/roles/42afac3d251b45ed822081a66ad20d6d => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:13.802147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837f187-6530-4d85-89cf-7e078a4fd49c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:13.899499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837f187-6530-4d85-89cf-7e078a4fd49c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:13.916332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:13.933044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6334226-b9e4-43f5-a11d-2ea8fd06ad09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:13.933670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334226-b9e4-43f5-a11d-2ea8fd06ad09 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:13.933946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334226-b9e4-43f5-a11d-2ea8fd06ad09 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:13.934215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334226-b9e4-43f5-a11d-2ea8fd06ad09 None admin] PATH_INFO: `/v3/users/cbbb0d8502d64d9eb879e5f4a5f6fc28` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:13.935384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6334226-b9e4-43f5-a11d-2ea8fd06ad09 None admin] RBAC: Authorizing `identity:get_user(user_id=cbbb0d8502d64d9eb879e5f4a5f6fc28)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:13.936805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6334226-b9e4-43f5-a11d-2ea8fd06ad09 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:13.938394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 548/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:13 2022] GET /identity/v3/users/cbbb0d8502d64d9eb879e5f4a5f6fc28 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:13.944435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe77d6-7215-4f88-9268-c5a27d745d83 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:14.040495 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe77d6-7215-4f88-9268-c5a27d745d83 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:14.068886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:14.074159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1875494-2af7-4091-baea-800243625b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:14.074873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1875494-2af7-4091-baea-800243625b3f None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:14.075152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1875494-2af7-4091-baea-800243625b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:14.075423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1875494-2af7-4091-baea-800243625b3f None admin] PATH_INFO: `/v3/projects/35c14e9135244dab97aefc49f9c9d86e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:14.076575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1875494-2af7-4091-baea-800243625b3f None admin] RBAC: Authorizing `identity:get_project(project_id=35c14e9135244dab97aefc49f9c9d86e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:14.077992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1875494-2af7-4091-baea-800243625b3f None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:14.079675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 574/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:13 2022] GET /identity/v3/projects/35c14e9135244dab97aefc49f9c9d86e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:14.085597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6334226-b9e4-43f5-a11d-2ea8fd06ad09 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:14.181567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6334226-b9e4-43f5-a11d-2ea8fd06ad09 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:14.214088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed75d-8345-4fea-9a95-2f847445a2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:14.214759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed75d-8345-4fea-9a95-2f847445a2eb None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:14.215036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed75d-8345-4fea-9a95-2f847445a2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:14.215305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed75d-8345-4fea-9a95-2f847445a2eb None admin] PATH_INFO: `/v3/projects/35c14e9135244dab97aefc49f9c9d86e/users/cbbb0d8502d64d9eb879e5f4a5f6fc28/roles/42afac3d251b45ed822081a66ad20d6d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:14.217428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bed75d-8345-4fea-9a95-2f847445a2eb None admin] RBAC: Authorizing `identity:create_grant(project_id=35c14e9135244dab97aefc49f9c9d86e, user_id=cbbb0d8502d64d9eb879e5f4a5f6fc28, role_id=42afac3d251b45ed822081a66ad20d6d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:14.218871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bed75d-8345-4fea-9a95-2f847445a2eb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:14.231625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 549/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:57:14 2022] PUT /identity/v3/projects/35c14e9135244dab97aefc49f9c9d86e/users/cbbb0d8502d64d9eb879e5f4a5f6fc28/roles/42afac3d251b45ed822081a66ad20d6d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:57:16.183084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f8e0b-0416-41d8-8f99-3e2b9227587d None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:16.183593 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f8e0b-0416-41d8-8f99-3e2b9227587d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:16.183593 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f8e0b-0416-41d8-8f99-3e2b9227587d None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:16.184918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 575/1124] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:16.189917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247034b6-9786-441f-b4dc-e9becb5fd668 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:16.190346 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247034b6-9786-441f-b4dc-e9becb5fd668 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:16.190481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247034b6-9786-441f-b4dc-e9becb5fd668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:16.209376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-247034b6-9786-441f-b4dc-e9becb5fd668 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:16.211180 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-247034b6-9786-441f-b4dc-e9becb5fd668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:16.250638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:16.281953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 550/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:16.304811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f8e0b-0416-41d8-8f99-3e2b9227587d None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:16.403611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f8e0b-0416-41d8-8f99-3e2b9227587d None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:16.443517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721f936-acdb-4345-8ad2-553fa53f37b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:16.444070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f936-acdb-4345-8ad2-553fa53f37b9 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:16.444350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f936-acdb-4345-8ad2-553fa53f37b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:16.445186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f936-acdb-4345-8ad2-553fa53f37b9 None admin] PATH_INFO: `/v3/roles/42afac3d251b45ed822081a66ad20d6d` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:16.446656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721f936-acdb-4345-8ad2-553fa53f37b9 None admin] RBAC: Authorizing `identity:get_role(role_id=42afac3d251b45ed822081a66ad20d6d)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:16.448023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721f936-acdb-4345-8ad2-553fa53f37b9 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:16.449365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 576/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:16 2022] GET /identity/v3/roles/42afac3d251b45ed822081a66ad20d6d => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:16.455300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247034b6-9786-441f-b4dc-e9becb5fd668 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:16.549760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247034b6-9786-441f-b4dc-e9becb5fd668 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:16.582758 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebacd74-f25c-415c-8240-c0ab540ba3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:16.583375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebacd74-f25c-415c-8240-c0ab540ba3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:16.583647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebacd74-f25c-415c-8240-c0ab540ba3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:16.583916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebacd74-f25c-415c-8240-c0ab540ba3d7 None admin] PATH_INFO: `/v3/users/cbbb0d8502d64d9eb879e5f4a5f6fc28` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:16.585081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebacd74-f25c-415c-8240-c0ab540ba3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cbbb0d8502d64d9eb879e5f4a5f6fc28)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:16.586522 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebacd74-f25c-415c-8240-c0ab540ba3d7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:16.588097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 551/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:16 2022] GET /identity/v3/users/cbbb0d8502d64d9eb879e5f4a5f6fc28 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:16.593761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721f936-acdb-4345-8ad2-553fa53f37b9 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:16.658765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:16.691670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721f936-acdb-4345-8ad2-553fa53f37b9 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:16.724559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86e020-8d4f-4795-aaa0-28e631b3bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:16.725099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86e020-8d4f-4795-aaa0-28e631b3bac6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:16.725380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86e020-8d4f-4795-aaa0-28e631b3bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:16.725679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86e020-8d4f-4795-aaa0-28e631b3bac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:16.790205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86e020-8d4f-4795-aaa0-28e631b3bac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:16.791685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86e020-8d4f-4795-aaa0-28e631b3bac6 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:16.854717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:16.888734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 577/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:57:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:57:16.894564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebacd74-f25c-415c-8240-c0ab540ba3d7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:16.939588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:16.992943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebacd74-f25c-415c-8240-c0ab540ba3d7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:17.024846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd8d8f-a1a8-4efd-9c21-8cb8d417a854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:17.025461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd8d8f-a1a8-4efd-9c21-8cb8d417a854 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:17.025735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd8d8f-a1a8-4efd-9c21-8cb8d417a854 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:17.026001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd8d8f-a1a8-4efd-9c21-8cb8d417a854 None admin] PATH_INFO: `/v3/projects/35c14e9135244dab97aefc49f9c9d86e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:17.027141 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd8d8f-a1a8-4efd-9c21-8cb8d417a854 None admin] RBAC: Authorizing `identity:get_project(project_id=35c14e9135244dab97aefc49f9c9d86e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:17.028544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd8d8f-a1a8-4efd-9c21-8cb8d417a854 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:17.030171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 552/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:16 2022] GET /identity/v3/projects/35c14e9135244dab97aefc49f9c9d86e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:17.036133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86e020-8d4f-4795-aaa0-28e631b3bac6 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:17.132165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86e020-8d4f-4795-aaa0-28e631b3bac6 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:17.164742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c66b61-da1d-47d9-8659-349031518e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:17.165331 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c66b61-da1d-47d9-8659-349031518e62 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:17.165607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c66b61-da1d-47d9-8659-349031518e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:17.165875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c66b61-da1d-47d9-8659-349031518e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:17.166676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c66b61-da1d-47d9-8659-349031518e62 None admin] RBAC: Adding query filter params (role.id=42afac3d251b45ed822081a66ad20d6d, scope.project.id=35c14e9135244dab97aefc49f9c9d86e, user.id=cbbb0d8502d64d9eb879e5f4a5f6fc28) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:17.166983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c66b61-da1d-47d9-8659-349031518e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:17.168401 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c66b61-da1d-47d9-8659-349031518e62 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:17.173962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 578/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:57:17 2022] GET /identity/v3/role_assignments?user.id=cbbb0d8502d64d9eb879e5f4a5f6fc28&scope.project.id=35c14e9135244dab97aefc49f9c9d86e&role.id=42afac3d251b45ed822081a66ad20d6d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:19.162186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29f46-531c-4f7b-b806-09143b2da541 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:19.162721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29f46-531c-4f7b-b806-09143b2da541 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:19.162721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29f46-531c-4f7b-b806-09143b2da541 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:19.164044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 553/1131] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:19.169152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762336b1-a3c1-42bc-b3a8-b1151e428527 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:19.169590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762336b1-a3c1-42bc-b3a8-b1151e428527 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:19.169692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762336b1-a3c1-42bc-b3a8-b1151e428527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:19.187187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-762336b1-a3c1-42bc-b3a8-b1151e428527 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:19.188351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-762336b1-a3c1-42bc-b3a8-b1151e428527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:19.214107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:19.253335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 579/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:19.276948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29f46-531c-4f7b-b806-09143b2da541 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:19.375796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29f46-531c-4f7b-b806-09143b2da541 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:19.388846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:19.410005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25386735-64ca-4602-94ba-a38dec5913bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:19.410703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25386735-64ca-4602-94ba-a38dec5913bf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:19.411157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25386735-64ca-4602-94ba-a38dec5913bf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:19.411608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25386735-64ca-4602-94ba-a38dec5913bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:19.413617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25386735-64ca-4602-94ba-a38dec5913bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:19.416168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25386735-64ca-4602-94ba-a38dec5913bf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:19.418111 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 554/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:57:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:19.423907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762336b1-a3c1-42bc-b3a8-b1151e428527 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:19.522216 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762336b1-a3c1-42bc-b3a8-b1151e428527 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:19.554671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a6878-c21d-4e72-80fb-b0414132ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:19.555267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6878-c21d-4e72-80fb-b0414132ae34 None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:19.555541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6878-c21d-4e72-80fb-b0414132ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:19.555807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6878-c21d-4e72-80fb-b0414132ae34 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:19.556475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a6878-c21d-4e72-80fb-b0414132ae34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:19.557893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a6878-c21d-4e72-80fb-b0414132ae34 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:19.584348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 580/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:57:19 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:57:21.590320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d895999-3096-4f24-a31e-2f915b29094f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:21.592245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d895999-3096-4f24-a31e-2f915b29094f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:21.592245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d895999-3096-4f24-a31e-2f915b29094f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:21.592512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 555/1135] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:21.598050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2057-082b-4378-a111-f42e528a7403 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:21.598512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2057-082b-4378-a111-f42e528a7403 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:21.598768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2057-082b-4378-a111-f42e528a7403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:21.617507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-198c2057-082b-4378-a111-f42e528a7403 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:21.618755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-198c2057-082b-4378-a111-f42e528a7403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:21.627712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:21.684908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 581/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:21.709683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d895999-3096-4f24-a31e-2f915b29094f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:21.806851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d895999-3096-4f24-a31e-2f915b29094f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:21.839341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04880401-5934-4af2-b1a5-ccfa922c41bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:21.839948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880401-5934-4af2-b1a5-ccfa922c41bb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:21.840228 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880401-5934-4af2-b1a5-ccfa922c41bb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:21.840548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880401-5934-4af2-b1a5-ccfa922c41bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:21.841612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04880401-5934-4af2-b1a5-ccfa922c41bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:21.843059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04880401-5934-4af2-b1a5-ccfa922c41bb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:21.844613 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 556/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:57:21.850146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c2057-082b-4378-a111-f42e528a7403 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:21.946316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c2057-082b-4378-a111-f42e528a7403 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:21.978447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2707f-2a13-47b7-aa01-d54be7f6dd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:21.979075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2707f-2a13-47b7-aa01-d54be7f6dd5e None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:21.979355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2707f-2a13-47b7-aa01-d54be7f6dd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:21.979634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2707f-2a13-47b7-aa01-d54be7f6dd5e None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:21.980311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2707f-2a13-47b7-aa01-d54be7f6dd5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:21.981737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2707f-2a13-47b7-aa01-d54be7f6dd5e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:21.998097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:22.006288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 582/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:57:21 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:57:24.010657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069e41-aaed-4f68-8310-a46a85629dc8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:24.011157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069e41-aaed-4f68-8310-a46a85629dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:24.011268 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069e41-aaed-4f68-8310-a46a85629dc8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:24.012555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 557/1139] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:24.017827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09ab5-1dda-438b-8a4e-c48a7b66427b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:24.018213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09ab5-1dda-438b-8a4e-c48a7b66427b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:24.018493 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09ab5-1dda-438b-8a4e-c48a7b66427b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:24.037044 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a3e09ab5-1dda-438b-8a4e-c48a7b66427b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:24.038225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a3e09ab5-1dda-438b-8a4e-c48a7b66427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:24.102785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 583/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:24.125723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66069e41-aaed-4f68-8310-a46a85629dc8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:24.175028 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:24.225518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66069e41-aaed-4f68-8310-a46a85629dc8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:24.258664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428b1ad-c2d8-4ce0-8cc0-8d797f337ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:24.259285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428b1ad-c2d8-4ce0-8cc0-8d797f337ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:24.259564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428b1ad-c2d8-4ce0-8cc0-8d797f337ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:24.259836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428b1ad-c2d8-4ce0-8cc0-8d797f337ef3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:24.269632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428b1ad-c2d8-4ce0-8cc0-8d797f337ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b428b1ad-c2d8-4ce0-8cc0-8d797f337ef3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:57:24.274501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:24.275658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:24.276777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 558/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:57:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:24.281632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09ab5-1dda-438b-8a4e-c48a7b66427b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:24.379918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09ab5-1dda-438b-8a4e-c48a7b66427b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:24.406871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:24.413532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a42a2-41fa-4b50-aa20-314ea23f390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:24.414137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a42a2-41fa-4b50-aa20-314ea23f390a None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:24.414412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a42a2-41fa-4b50-aa20-314ea23f390a None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:24.414713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a42a2-41fa-4b50-aa20-314ea23f390a None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:24.415423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a42a2-41fa-4b50-aa20-314ea23f390a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:24.415720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a42a2-41fa-4b50-aa20-314ea23f390a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:24.417080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a42a2-41fa-4b50-aa20-314ea23f390a None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:24.424907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 584/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:57:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:24.431406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428b1ad-c2d8-4ce0-8cc0-8d797f337ef3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:24.527857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428b1ad-c2d8-4ce0-8cc0-8d797f337ef3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:24.536217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:24.561450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f9fa6-8b91-4dac-8c72-4ae3c0b17748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:24.562057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f9fa6-8b91-4dac-8c72-4ae3c0b17748 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:24.562331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f9fa6-8b91-4dac-8c72-4ae3c0b17748 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:24.562628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f9fa6-8b91-4dac-8c72-4ae3c0b17748 None admin] PATH_INFO: `/v3/users/1cba0797745e4949b2dbefb2e8a59c5d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:24.575485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f9fa6-8b91-4dac-8c72-4ae3c0b17748 None admin] RBAC: Authorizing `identity:get_user(user_id=1cba0797745e4949b2dbefb2e8a59c5d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:24.576904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f9fa6-8b91-4dac-8c72-4ae3c0b17748 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:24.578505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 559/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:24 2022] GET /identity/v3/users/1cba0797745e4949b2dbefb2e8a59c5d => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:24.584064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a42a2-41fa-4b50-aa20-314ea23f390a None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:24.687975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a42a2-41fa-4b50-aa20-314ea23f390a None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:24.720489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002d32-bee1-492d-9ae2-2b984d4326b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:24.721093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002d32-bee1-492d-9ae2-2b984d4326b3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:24.721373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002d32-bee1-492d-9ae2-2b984d4326b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:24.721644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002d32-bee1-492d-9ae2-2b984d4326b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:24.777452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:24.786685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002d32-bee1-492d-9ae2-2b984d4326b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:24.788717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002d32-bee1-492d-9ae2-2b984d4326b3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:24.885121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 585/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:57:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:57:24.890881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f9fa6-8b91-4dac-8c72-4ae3c0b17748 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:24.986304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f9fa6-8b91-4dac-8c72-4ae3c0b17748 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:25.018046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baddb90-6bde-4fb5-80df-bb2942c83071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:25.018690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baddb90-6bde-4fb5-80df-bb2942c83071 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:25.018960 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baddb90-6bde-4fb5-80df-bb2942c83071 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:25.019225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baddb90-6bde-4fb5-80df-bb2942c83071 None admin] PATH_INFO: `/v3/projects/fcd370ec485e46f980995ed43350f677` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:25.020344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baddb90-6bde-4fb5-80df-bb2942c83071 None admin] RBAC: Authorizing `identity:get_project(project_id=fcd370ec485e46f980995ed43350f677)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:25.021758 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baddb90-6bde-4fb5-80df-bb2942c83071 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:25.023934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 560/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:24 2022] GET /identity/v3/projects/fcd370ec485e46f980995ed43350f677 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:25.029802 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002d32-bee1-492d-9ae2-2b984d4326b3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:25.116186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:25.125122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002d32-bee1-492d-9ae2-2b984d4326b3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:25.158054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672fa7e-ba74-41b9-a221-b568d00876ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:25.158662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672fa7e-ba74-41b9-a221-b568d00876ae None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:25.158939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672fa7e-ba74-41b9-a221-b568d00876ae None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:25.159206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672fa7e-ba74-41b9-a221-b568d00876ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:25.159981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672fa7e-ba74-41b9-a221-b568d00876ae None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=fcd370ec485e46f980995ed43350f677, user.id=1cba0797745e4949b2dbefb2e8a59c5d) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:25.160285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672fa7e-ba74-41b9-a221-b568d00876ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:25.161695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672fa7e-ba74-41b9-a221-b568d00876ae None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:25.166919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 586/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:57:25 2022] GET /identity/v3/role_assignments?user.id=1cba0797745e4949b2dbefb2e8a59c5d&scope.project.id=fcd370ec485e46f980995ed43350f677&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:27.131774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c454-3380-4913-87ff-7139d89d8ad9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:27.132279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c454-3380-4913-87ff-7139d89d8ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:27.132279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c454-3380-4913-87ff-7139d89d8ad9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:27.133570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 561/1147] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:27.138612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4fdee-a3e1-4287-bcd3-c4982bfd3c4f None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:27.139026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4fdee-a3e1-4287-bcd3-c4982bfd3c4f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:27.139164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4fdee-a3e1-4287-bcd3-c4982bfd3c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:27.157223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-28f4fdee-a3e1-4287-bcd3-c4982bfd3c4f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:27.158395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-28f4fdee-a3e1-4287-bcd3-c4982bfd3c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:27.223503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 587/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:27.245392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c454-3380-4913-87ff-7139d89d8ad9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:27.279503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:27.344867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c454-3380-4913-87ff-7139d89d8ad9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:27.376671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0a26d-e47a-42d5-92a0-fc60d4a6af3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:27.377281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0a26d-e47a-42d5-92a0-fc60d4a6af3e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:27.377555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0a26d-e47a-42d5-92a0-fc60d4a6af3e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:27.377821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0a26d-e47a-42d5-92a0-fc60d4a6af3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:27.388038 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0a26d-e47a-42d5-92a0-fc60d4a6af3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-78d0a26d-e47a-42d5-92a0-fc60d4a6af3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:57:27.392775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:27.393855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:27.394916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 562/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:57:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:27.400260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4fdee-a3e1-4287-bcd3-c4982bfd3c4f None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:27.480988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:27.495599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4fdee-a3e1-4287-bcd3-c4982bfd3c4f None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:27.528591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82400d58-95a5-44a3-bf78-86312292c1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:27.529191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82400d58-95a5-44a3-bf78-86312292c1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:27.529469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82400d58-95a5-44a3-bf78-86312292c1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:27.529738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82400d58-95a5-44a3-bf78-86312292c1e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:27.530470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82400d58-95a5-44a3-bf78-86312292c1e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:27.530777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82400d58-95a5-44a3-bf78-86312292c1e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:27.532141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82400d58-95a5-44a3-bf78-86312292c1e1 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:27.539863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 588/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:57:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:27.545463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0a26d-e47a-42d5-92a0-fc60d4a6af3e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:27.636165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:27.643205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0a26d-e47a-42d5-92a0-fc60d4a6af3e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:27.676465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdee33-6c87-414b-af36-f7d5d73aa547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:27.677085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdee33-6c87-414b-af36-f7d5d73aa547 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:27.677365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdee33-6c87-414b-af36-f7d5d73aa547 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:27.677634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdee33-6c87-414b-af36-f7d5d73aa547 None admin] PATH_INFO: `/v3/users/1cba0797745e4949b2dbefb2e8a59c5d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:27.679305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdee33-6c87-414b-af36-f7d5d73aa547 None admin] RBAC: Authorizing `identity:get_user(user_id=1cba0797745e4949b2dbefb2e8a59c5d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:27.680721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdee33-6c87-414b-af36-f7d5d73aa547 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:27.682304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 563/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:27 2022] GET /identity/v3/users/1cba0797745e4949b2dbefb2e8a59c5d => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:27.688087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82400d58-95a5-44a3-bf78-86312292c1e1 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:27.784807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82400d58-95a5-44a3-bf78-86312292c1e1 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:27.817259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a4b16-2c6a-4ad4-a36c-7002524618f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:27.817873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4b16-2c6a-4ad4-a36c-7002524618f2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:27.818150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4b16-2c6a-4ad4-a36c-7002524618f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:27.818426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4b16-2c6a-4ad4-a36c-7002524618f2 None admin] PATH_INFO: `/v3/projects/fcd370ec485e46f980995ed43350f677` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:27.820188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4b16-2c6a-4ad4-a36c-7002524618f2 None admin] RBAC: Authorizing `identity:get_project(project_id=fcd370ec485e46f980995ed43350f677)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:27.821605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4b16-2c6a-4ad4-a36c-7002524618f2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:27.823294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 589/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:27 2022] GET /identity/v3/projects/fcd370ec485e46f980995ed43350f677 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:27.829148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdee33-6c87-414b-af36-f7d5d73aa547 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:27.930225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdee33-6c87-414b-af36-f7d5d73aa547 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:27.963294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4142ea-6ae5-49a2-a84c-5e607d665bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:27.963945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4142ea-6ae5-49a2-a84c-5e607d665bed None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:27.964222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4142ea-6ae5-49a2-a84c-5e607d665bed None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:27.964491 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4142ea-6ae5-49a2-a84c-5e607d665bed None admin] PATH_INFO: `/v3/projects/fcd370ec485e46f980995ed43350f677/users/1cba0797745e4949b2dbefb2e8a59c5d/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:27.966384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4142ea-6ae5-49a2-a84c-5e607d665bed None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd370ec485e46f980995ed43350f677, user_id=1cba0797745e4949b2dbefb2e8a59c5d, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:27.967834 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4142ea-6ae5-49a2-a84c-5e607d665bed None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:27.980186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 564/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:57:27 2022] PUT /identity/v3/projects/fcd370ec485e46f980995ed43350f677/users/1cba0797745e4949b2dbefb2e8a59c5d/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:57:29.950744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0732c1-98e4-4d71-8d8d-7e175a47ec46 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:29.951270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0732c1-98e4-4d71-8d8d-7e175a47ec46 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:29.951270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0732c1-98e4-4d71-8d8d-7e175a47ec46 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:29.952627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 590/1154] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:29.957752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107746-89b5-4f42-a664-935069c16069 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:29.958165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107746-89b5-4f42-a664-935069c16069 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:29.958274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107746-89b5-4f42-a664-935069c16069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:29.977564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e0107746-89b5-4f42-a664-935069c16069 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:29.978796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e0107746-89b5-4f42-a664-935069c16069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:29.994548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:30.043429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 565/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:30.065668 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0732c1-98e4-4d71-8d8d-7e175a47ec46 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:30.083889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:30.164418 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0732c1-98e4-4d71-8d8d-7e175a47ec46 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:30.196158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311ab8d-e7a9-4b4e-b5de-9bd54f3755e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:30.196765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311ab8d-e7a9-4b4e-b5de-9bd54f3755e1 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:30.197041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311ab8d-e7a9-4b4e-b5de-9bd54f3755e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:30.197306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311ab8d-e7a9-4b4e-b5de-9bd54f3755e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:30.206890 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311ab8d-e7a9-4b4e-b5de-9bd54f3755e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-6311ab8d-e7a9-4b4e-b5de-9bd54f3755e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:57:30.212251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:30.213364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:57:30.214594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 591/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:57:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:30.219348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0107746-89b5-4f42-a664-935069c16069 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:30.314214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0107746-89b5-4f42-a664-935069c16069 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:30.349910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918942-e83a-4736-975d-17fc22cd98b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:30.350576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918942-e83a-4736-975d-17fc22cd98b2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:30.350857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918942-e83a-4736-975d-17fc22cd98b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:30.351128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918942-e83a-4736-975d-17fc22cd98b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:30.351838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1918942-e83a-4736-975d-17fc22cd98b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:30.352140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1918942-e83a-4736-975d-17fc22cd98b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:30.353509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1918942-e83a-4736-975d-17fc22cd98b2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:30.361301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 566/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:57:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:30.367065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311ab8d-e7a9-4b4e-b5de-9bd54f3755e1 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:30.441162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:30.464586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311ab8d-e7a9-4b4e-b5de-9bd54f3755e1 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:30.498106 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513e088-0b93-4bf8-a83a-59fdba4a1ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:30.498756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513e088-0b93-4bf8-a83a-59fdba4a1ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:30.499034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513e088-0b93-4bf8-a83a-59fdba4a1ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:30.499304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513e088-0b93-4bf8-a83a-59fdba4a1ee6 None admin] PATH_INFO: `/v3/users/1cba0797745e4949b2dbefb2e8a59c5d` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:30.500598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513e088-0b93-4bf8-a83a-59fdba4a1ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=1cba0797745e4949b2dbefb2e8a59c5d)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:30.502034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513e088-0b93-4bf8-a83a-59fdba4a1ee6 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:30.503649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 592/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:30 2022] GET /identity/v3/users/1cba0797745e4949b2dbefb2e8a59c5d => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:30.509936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918942-e83a-4736-975d-17fc22cd98b2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:30.526254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:30.607886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918942-e83a-4736-975d-17fc22cd98b2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:30.640572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ff69f-de53-417a-b085-5a17ef0026f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:30.641183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ff69f-de53-417a-b085-5a17ef0026f0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:30.641464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ff69f-de53-417a-b085-5a17ef0026f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:30.641735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ff69f-de53-417a-b085-5a17ef0026f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:30.708096 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ff69f-de53-417a-b085-5a17ef0026f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:30.709474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ff69f-de53-417a-b085-5a17ef0026f0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:30.723163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:30.804313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 567/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:57:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:57:30.810220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513e088-0b93-4bf8-a83a-59fdba4a1ee6 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:30.908364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513e088-0b93-4bf8-a83a-59fdba4a1ee6 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:30.941938 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6136a48-e361-42fe-bb42-b4279133dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:30.942589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6136a48-e361-42fe-bb42-b4279133dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:30.942865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6136a48-e361-42fe-bb42-b4279133dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:30.943133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6136a48-e361-42fe-bb42-b4279133dee2 None admin] PATH_INFO: `/v3/projects/fcd370ec485e46f980995ed43350f677` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:30.944283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6136a48-e361-42fe-bb42-b4279133dee2 None admin] RBAC: Authorizing `identity:get_project(project_id=fcd370ec485e46f980995ed43350f677)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:30.945711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6136a48-e361-42fe-bb42-b4279133dee2 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:30.947389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 593/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:30 2022] GET /identity/v3/projects/fcd370ec485e46f980995ed43350f677 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:30.953443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ff69f-de53-417a-b085-5a17ef0026f0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:31.049560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ff69f-de53-417a-b085-5a17ef0026f0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:31.062968 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:31.083507 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1e5f-99e3-4f0c-8480-6138cf744a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:31.084110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1e5f-99e3-4f0c-8480-6138cf744a32 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:31.084390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1e5f-99e3-4f0c-8480-6138cf744a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:31.084663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1e5f-99e3-4f0c-8480-6138cf744a32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:31.085979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1e5f-99e3-4f0c-8480-6138cf744a32 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=fcd370ec485e46f980995ed43350f677, user.id=1cba0797745e4949b2dbefb2e8a59c5d) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:31.086290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1e5f-99e3-4f0c-8480-6138cf744a32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:31.087738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1e5f-99e3-4f0c-8480-6138cf744a32 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:31.093324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 568/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:57:30 2022] GET /identity/v3/role_assignments?user.id=1cba0797745e4949b2dbefb2e8a59c5d&scope.project.id=fcd370ec485e46f980995ed43350f677&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:33.077950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7220f35-6227-4e25-9f2e-ffc380da7b6b None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:33.078496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7220f35-6227-4e25-9f2e-ffc380da7b6b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:33.078606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7220f35-6227-4e25-9f2e-ffc380da7b6b None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:33.079870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 594/1162] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:33.085012 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76756b1-88ec-4f23-b906-5dab5c17283b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:33.085423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76756b1-88ec-4f23-b906-5dab5c17283b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:33.085549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76756b1-88ec-4f23-b906-5dab5c17283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:33.103124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c76756b1-88ec-4f23-b906-5dab5c17283b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:33.104292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c76756b1-88ec-4f23-b906-5dab5c17283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:33.169756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 569/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:33.191622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7220f35-6227-4e25-9f2e-ffc380da7b6b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:33.208933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:33.293235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7220f35-6227-4e25-9f2e-ffc380da7b6b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:33.326915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7ae01-88fb-49ed-86e5-e44eee8c020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:33.327517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7ae01-88fb-49ed-86e5-e44eee8c020c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:33.327790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7ae01-88fb-49ed-86e5-e44eee8c020c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:33.328056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7ae01-88fb-49ed-86e5-e44eee8c020c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:33.391765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7ae01-88fb-49ed-86e5-e44eee8c020c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:33.393196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7ae01-88fb-49ed-86e5-e44eee8c020c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:33.405966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:33.487844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 595/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:57:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:57:33.495454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76756b1-88ec-4f23-b906-5dab5c17283b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:33.591194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76756b1-88ec-4f23-b906-5dab5c17283b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:33.600052 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:33.625300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524f543-12f8-43ef-9181-cfa0f0be77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:33.625919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524f543-12f8-43ef-9181-cfa0f0be77ac None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:33.626195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524f543-12f8-43ef-9181-cfa0f0be77ac None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:33.626481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524f543-12f8-43ef-9181-cfa0f0be77ac None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:33.633126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524f543-12f8-43ef-9181-cfa0f0be77ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:33.634572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524f543-12f8-43ef-9181-cfa0f0be77ac None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0524f543-12f8-43ef-9181-cfa0f0be77ac None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:33.645757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:33.646974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:33.648040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 570/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jul 28 01:57:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:33.653166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7ae01-88fb-49ed-86e5-e44eee8c020c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:33.750722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7ae01-88fb-49ed-86e5-e44eee8c020c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:33.763406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:33.785015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ee351-8308-4134-a953-bb3cf7736e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:33.785619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ee351-8308-4134-a953-bb3cf7736e0d None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:33.785902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ee351-8308-4134-a953-bb3cf7736e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:33.786177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ee351-8308-4134-a953-bb3cf7736e0d None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:33.786910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ee351-8308-4134-a953-bb3cf7736e0d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:33.787213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ee351-8308-4134-a953-bb3cf7736e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:33.789119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ee351-8308-4134-a953-bb3cf7736e0d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:33.796132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 596/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Jul 28 01:57:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:35.760091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8c0f7-e511-4852-88b3-c626a01d6dfd None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:35.760621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8c0f7-e511-4852-88b3-c626a01d6dfd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:35.760621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8c0f7-e511-4852-88b3-c626a01d6dfd None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:35.761974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 571/1167] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:35.767124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde4e0b-7463-44cd-8fb5-c83321916c89 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:35.767526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde4e0b-7463-44cd-8fb5-c83321916c89 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:35.767677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde4e0b-7463-44cd-8fb5-c83321916c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:35.785869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-dbde4e0b-7463-44cd-8fb5-c83321916c89 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:35.787072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-dbde4e0b-7463-44cd-8fb5-c83321916c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:35.850950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 597/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:35.873280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8c0f7-e511-4852-88b3-c626a01d6dfd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:35.971326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8c0f7-e511-4852-88b3-c626a01d6dfd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:36.003288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b60e3-9f59-4914-bf01-9a244574462c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:36.003890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b60e3-9f59-4914-bf01-9a244574462c None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:36.004167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b60e3-9f59-4914-bf01-9a244574462c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:36.004438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b60e3-9f59-4914-bf01-9a244574462c None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:36.005132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b60e3-9f59-4914-bf01-9a244574462c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:36.006550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b60e3-9f59-4914-bf01-9a244574462c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:36.022329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 572/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Thu Jul 28 01:57:35 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:57:37.997569 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0db8-f021-44a1-89de-8e0671b7dfe5 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:37.998099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0db8-f021-44a1-89de-8e0671b7dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:37.998099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0db8-f021-44a1-89de-8e0671b7dfe5 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:37.999530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 598/1170] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:38.004661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939c3a5-fd72-42e3-872d-43680e102c44 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:38.005064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939c3a5-fd72-42e3-872d-43680e102c44 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:38.005210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939c3a5-fd72-42e3-872d-43680e102c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:38.022919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e939c3a5-fd72-42e3-872d-43680e102c44 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:38.024086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e939c3a5-fd72-42e3-872d-43680e102c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:38.046425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:38.090680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 573/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:38.113704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce0db8-f021-44a1-89de-8e0671b7dfe5 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:38.213490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce0db8-f021-44a1-89de-8e0671b7dfe5 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:38.220473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:38.247112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8f55-6db8-4094-9d99-348a4083de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:38.247734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8f55-6db8-4094-9d99-348a4083de76 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:38.248013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8f55-6db8-4094-9d99-348a4083de76 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:38.248287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8f55-6db8-4094-9d99-348a4083de76 None admin] PATH_INFO: `/v3/domains/232d0f3d22494543b2d86b0ac92400dc` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:38.258320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8f55-6db8-4094-9d99-348a4083de76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=232d0f3d22494543b2d86b0ac92400dc)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:38.259790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8f55-6db8-4094-9d99-348a4083de76 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:38.261370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 599/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Jul 28 01:57:38 2022] GET /identity/v3/domains/232d0f3d22494543b2d86b0ac92400dc => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:38.267159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939c3a5-fd72-42e3-872d-43680e102c44 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:38.371109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939c3a5-fd72-42e3-872d-43680e102c44 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:38.404075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077f49c-dfce-459f-b074-48027e75018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:38.404682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077f49c-dfce-459f-b074-48027e75018e None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:38.404956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077f49c-dfce-459f-b074-48027e75018e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:38.405222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077f49c-dfce-459f-b074-48027e75018e None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:38.405897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077f49c-dfce-459f-b074-48027e75018e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:38.407342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077f49c-dfce-459f-b074-48027e75018e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:38.432998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 574/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:57:38 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:57:40.445691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9c4d6-4906-4453-918c-6ab49251804c None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:40.446248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9c4d6-4906-4453-918c-6ab49251804c None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:40.446248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9c4d6-4906-4453-918c-6ab49251804c None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:40.447615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 600/1174] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:40.452791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94e55-a8bd-4484-8c71-43d103699711 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:40.453173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94e55-a8bd-4484-8c71-43d103699711 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:40.453351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94e55-a8bd-4484-8c71-43d103699711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:40.471576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-efe94e55-a8bd-4484-8c71-43d103699711 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:40.472756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-efe94e55-a8bd-4484-8c71-43d103699711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:40.476067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:40.537433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 575/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:40.561870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9c4d6-4906-4453-918c-6ab49251804c None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:40.661473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9c4d6-4906-4453-918c-6ab49251804c None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:40.694359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2833a-d6c0-4db0-88b1-e70dc83c031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:40.694999 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2833a-d6c0-4db0-88b1-e70dc83c031e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:40.695273 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2833a-d6c0-4db0-88b1-e70dc83c031e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:40.695541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2833a-d6c0-4db0-88b1-e70dc83c031e None admin] PATH_INFO: `/v3/domains/232d0f3d22494543b2d86b0ac92400dc` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:40.696731 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2833a-d6c0-4db0-88b1-e70dc83c031e None admin] RBAC: Authorizing `identity:get_domain(domain_id=232d0f3d22494543b2d86b0ac92400dc)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:40.698093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2833a-d6c0-4db0-88b1-e70dc83c031e None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:40.699678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 601/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Jul 28 01:57:40 2022] GET /identity/v3/domains/232d0f3d22494543b2d86b0ac92400dc => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:40.705261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe94e55-a8bd-4484-8c71-43d103699711 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:40.801580 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe94e55-a8bd-4484-8c71-43d103699711 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:40.834508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667efa0-f49a-47eb-8b49-3c720b3aa4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:40.835627 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667efa0-f49a-47eb-8b49-3c720b3aa4d8 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:40.835908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667efa0-f49a-47eb-8b49-3c720b3aa4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:40.836172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667efa0-f49a-47eb-8b49-3c720b3aa4d8 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:40.836854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667efa0-f49a-47eb-8b49-3c720b3aa4d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:40.838261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667efa0-f49a-47eb-8b49-3c720b3aa4d8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:40.848886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:40.859277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 576/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:57:40 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 01:57:42.878997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9740f-751b-4deb-91ea-2a19604e5e59 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:42.879392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9740f-751b-4deb-91ea-2a19604e5e59 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:42.879533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9740f-751b-4deb-91ea-2a19604e5e59 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:42.880871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 602/1178] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:42.886499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982fd56-c23f-481c-a9fb-d1bddac10aeb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:42.886941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982fd56-c23f-481c-a9fb-d1bddac10aeb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:42.887035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982fd56-c23f-481c-a9fb-d1bddac10aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:42.904701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e982fd56-c23f-481c-a9fb-d1bddac10aeb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:42.905896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e982fd56-c23f-481c-a9fb-d1bddac10aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:42.969977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 577/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:57:42.993144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9740f-751b-4deb-91ea-2a19604e5e59 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:43.027419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:43.091953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9740f-751b-4deb-91ea-2a19604e5e59 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:43.125532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0edc9-fa71-4f38-a431-dbc937f9ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:43.126203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0edc9-fa71-4f38-a431-dbc937f9ba83 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:43.126459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0edc9-fa71-4f38-a431-dbc937f9ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:43.126741 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0edc9-fa71-4f38-a431-dbc937f9ba83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:43.136600 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0edc9-fa71-4f38-a431-dbc937f9ba83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-08e0edc9-fa71-4f38-a431-dbc937f9ba83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:57:43.141526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:43.142645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:57:43.143676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 603/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:57:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:43.148631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982fd56-c23f-481c-a9fb-d1bddac10aeb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:43.243781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982fd56-c23f-481c-a9fb-d1bddac10aeb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:43.267897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:43.277593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a376-9a14-48a9-935a-03706dc497d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:43.277593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a376-9a14-48a9-935a-03706dc497d9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:43.277851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a376-9a14-48a9-935a-03706dc497d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:43.277936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a376-9a14-48a9-935a-03706dc497d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:43.279131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11a376-9a14-48a9-935a-03706dc497d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:43.279131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11a376-9a14-48a9-935a-03706dc497d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:43.280322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11a376-9a14-48a9-935a-03706dc497d9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:43.289733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 578/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:43.295364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0edc9-fa71-4f38-a431-dbc937f9ba83 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:43.387677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:43.394791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0edc9-fa71-4f38-a431-dbc937f9ba83 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:43.427552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61dc5-6c8a-4a8e-8d8c-6ef7c7756e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:43.428751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61dc5-6c8a-4a8e-8d8c-6ef7c7756e44 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:43.429059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61dc5-6c8a-4a8e-8d8c-6ef7c7756e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:43.429330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61dc5-6c8a-4a8e-8d8c-6ef7c7756e44 None admin] PATH_INFO: `/v3/users/ac33e2aaafd5411eaf1a6bb27c518166` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:43.442169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b61dc5-6c8a-4a8e-8d8c-6ef7c7756e44 None admin] RBAC: Authorizing `identity:get_user(user_id=ac33e2aaafd5411eaf1a6bb27c518166)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:43.443644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b61dc5-6c8a-4a8e-8d8c-6ef7c7756e44 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:43.445271 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 604/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:43 2022] GET /identity/v3/users/ac33e2aaafd5411eaf1a6bb27c518166 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:43.450995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a376-9a14-48a9-935a-03706dc497d9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:43.546556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a376-9a14-48a9-935a-03706dc497d9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:43.580601 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2fc11-3989-498a-b7a9-9426ee1c35f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:43.581194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2fc11-3989-498a-b7a9-9426ee1c35f0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:43.581470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2fc11-3989-498a-b7a9-9426ee1c35f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:43.581738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2fc11-3989-498a-b7a9-9426ee1c35f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:43.634150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:43.646177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2fc11-3989-498a-b7a9-9426ee1c35f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:43.648110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2fc11-3989-498a-b7a9-9426ee1c35f0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:43.741252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 579/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:57:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:57:43.747110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61dc5-6c8a-4a8e-8d8c-6ef7c7756e44 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:43.842244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61dc5-6c8a-4a8e-8d8c-6ef7c7756e44 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:43.875605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de865d89-9198-48f4-9f99-4606f6f3af93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:43.876236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de865d89-9198-48f4-9f99-4606f6f3af93 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:43.876867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de865d89-9198-48f4-9f99-4606f6f3af93 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:43.876867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de865d89-9198-48f4-9f99-4606f6f3af93 None admin] PATH_INFO: `/v3/projects/6d9b533f5c16427f8293e5521f24ee78` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:43.877920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de865d89-9198-48f4-9f99-4606f6f3af93 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9b533f5c16427f8293e5521f24ee78)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:43.879381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de865d89-9198-48f4-9f99-4606f6f3af93 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:43.881015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 605/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:43 2022] GET /identity/v3/projects/6d9b533f5c16427f8293e5521f24ee78 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:43.887088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2fc11-3989-498a-b7a9-9426ee1c35f0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:43.970489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:43.982801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2fc11-3989-498a-b7a9-9426ee1c35f0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:44.015859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2afeda-82e8-42d5-a64c-3ad1032edde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:44.016449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2afeda-82e8-42d5-a64c-3ad1032edde3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:44.016722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2afeda-82e8-42d5-a64c-3ad1032edde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:44.016990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2afeda-82e8-42d5-a64c-3ad1032edde3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:44.017757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2afeda-82e8-42d5-a64c-3ad1032edde3 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=6d9b533f5c16427f8293e5521f24ee78, user.id=ac33e2aaafd5411eaf1a6bb27c518166) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:44.018066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2afeda-82e8-42d5-a64c-3ad1032edde3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:44.019514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2afeda-82e8-42d5-a64c-3ad1032edde3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:44.024690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 580/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:57:43 2022] GET /identity/v3/role_assignments?user.id=ac33e2aaafd5411eaf1a6bb27c518166&scope.project.id=6d9b533f5c16427f8293e5521f24ee78&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:45.970192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f558ef-8380-4c1c-aa4b-fcdbe6971258 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:45.970745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f558ef-8380-4c1c-aa4b-fcdbe6971258 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:45.970745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f558ef-8380-4c1c-aa4b-fcdbe6971258 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:45.972115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 606/1186] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:45.977227 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344f2e-4a9b-45c5-8f85-b3cc714d9869 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:45.977644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344f2e-4a9b-45c5-8f85-b3cc714d9869 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:45.977781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344f2e-4a9b-45c5-8f85-b3cc714d9869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:45.996010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b1344f2e-4a9b-45c5-8f85-b3cc714d9869 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:45.997196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b1344f2e-4a9b-45c5-8f85-b3cc714d9869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:46.062449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 581/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:46.084574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f558ef-8380-4c1c-aa4b-fcdbe6971258 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:46.106219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:46.184124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f558ef-8380-4c1c-aa4b-fcdbe6971258 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:46.217005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d71969-7fd8-4ad0-a618-f29070290c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:46.217614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d71969-7fd8-4ad0-a618-f29070290c3e None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:46.217893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d71969-7fd8-4ad0-a618-f29070290c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:46.218166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d71969-7fd8-4ad0-a618-f29070290c3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:46.228384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d71969-7fd8-4ad0-a618-f29070290c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-49d71969-7fd8-4ad0-a618-f29070290c3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:57:46.233247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:46.234403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:57:46.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 607/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:57:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:46.240366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344f2e-4a9b-45c5-8f85-b3cc714d9869 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:46.319272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:46.337187 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344f2e-4a9b-45c5-8f85-b3cc714d9869 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:46.370426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867dbbb-361f-4979-973b-0535583f596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:46.371057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867dbbb-361f-4979-973b-0535583f596e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:46.371336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867dbbb-361f-4979-973b-0535583f596e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:46.371609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867dbbb-361f-4979-973b-0535583f596e None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:46.372316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867dbbb-361f-4979-973b-0535583f596e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:46.372620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867dbbb-361f-4979-973b-0535583f596e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:46.373984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867dbbb-361f-4979-973b-0535583f596e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:46.382332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 582/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:57:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:46.387930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d71969-7fd8-4ad0-a618-f29070290c3e None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:46.468347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:46.490400 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d71969-7fd8-4ad0-a618-f29070290c3e None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:46.523104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5072f-8a19-4bfc-a025-12afaf0450a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:46.523725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5072f-8a19-4bfc-a025-12afaf0450a3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:46.524002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5072f-8a19-4bfc-a025-12afaf0450a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:46.524272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5072f-8a19-4bfc-a025-12afaf0450a3 None admin] PATH_INFO: `/v3/users/ac33e2aaafd5411eaf1a6bb27c518166` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:46.525439 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5072f-8a19-4bfc-a025-12afaf0450a3 None admin] RBAC: Authorizing `identity:get_user(user_id=ac33e2aaafd5411eaf1a6bb27c518166)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:46.526908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5072f-8a19-4bfc-a025-12afaf0450a3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:46.528490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 608/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:46 2022] GET /identity/v3/users/ac33e2aaafd5411eaf1a6bb27c518166 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:46.534314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867dbbb-361f-4979-973b-0535583f596e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:46.630927 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867dbbb-361f-4979-973b-0535583f596e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:46.663672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5048715-df18-47c5-9782-262b2c87f728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:46.664288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5048715-df18-47c5-9782-262b2c87f728 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:46.664563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5048715-df18-47c5-9782-262b2c87f728 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:46.664833 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5048715-df18-47c5-9782-262b2c87f728 None admin] PATH_INFO: `/v3/projects/6d9b533f5c16427f8293e5521f24ee78` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:46.665966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5048715-df18-47c5-9782-262b2c87f728 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9b533f5c16427f8293e5521f24ee78)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:46.667418 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5048715-df18-47c5-9782-262b2c87f728 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:46.669042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 583/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:46 2022] GET /identity/v3/projects/6d9b533f5c16427f8293e5521f24ee78 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:46.674873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5072f-8a19-4bfc-a025-12afaf0450a3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:46.769244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5072f-8a19-4bfc-a025-12afaf0450a3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:46.801397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71537e-63ff-4a33-9a95-b42f5bc77a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:46.802025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71537e-63ff-4a33-9a95-b42f5bc77a44 None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:46.802299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71537e-63ff-4a33-9a95-b42f5bc77a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:46.802601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71537e-63ff-4a33-9a95-b42f5bc77a44 None admin] PATH_INFO: `/v3/projects/6d9b533f5c16427f8293e5521f24ee78/users/ac33e2aaafd5411eaf1a6bb27c518166/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:46.804524 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71537e-63ff-4a33-9a95-b42f5bc77a44 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d9b533f5c16427f8293e5521f24ee78, user_id=ac33e2aaafd5411eaf1a6bb27c518166, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:46.805930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71537e-63ff-4a33-9a95-b42f5bc77a44 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:46.818022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 609/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:57:46 2022] PUT /identity/v3/projects/6d9b533f5c16427f8293e5521f24ee78/users/ac33e2aaafd5411eaf1a6bb27c518166/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:57:48.784367 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1938b3-1e2e-4b98-9a97-7994f9655daf None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:48.784928 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1938b3-1e2e-4b98-9a97-7994f9655daf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:48.784928 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1938b3-1e2e-4b98-9a97-7994f9655daf None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:48.786255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 584/1193] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:57:48.791844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728bb5-57b3-4787-b756-daecb30898d4 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:48.792237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728bb5-57b3-4787-b756-daecb30898d4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:48.792397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728bb5-57b3-4787-b756-daecb30898d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:48.810050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-6c728bb5-57b3-4787-b756-daecb30898d4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:57:48.811272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6c728bb5-57b3-4787-b756-daecb30898d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:57:48.813179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:48.878728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 610/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:57:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:57:48.901509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1938b3-1e2e-4b98-9a97-7994f9655daf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:48.917235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:49.002104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1938b3-1e2e-4b98-9a97-7994f9655daf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:49.034364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8be62-992f-4bf9-a33f-69a2dbf38ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:49.035071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8be62-992f-4bf9-a33f-69a2dbf38ffd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:49.035297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8be62-992f-4bf9-a33f-69a2dbf38ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:49.035565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8be62-992f-4bf9-a33f-69a2dbf38ffd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:49.046200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8be62-992f-4bf9-a33f-69a2dbf38ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-08b8be62-992f-4bf9-a33f-69a2dbf38ffd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:57:49.051063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:57:49.052179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:57:49.053219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 585/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:57:49.058256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c728bb5-57b3-4787-b756-daecb30898d4 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:49.153564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c728bb5-57b3-4787-b756-daecb30898d4 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:49.185452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afcb61-d558-4483-82e4-7b8b6b4a14c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:49.186048 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afcb61-d558-4483-82e4-7b8b6b4a14c4 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:49.186327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afcb61-d558-4483-82e4-7b8b6b4a14c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:49.186633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afcb61-d558-4483-82e4-7b8b6b4a14c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:49.187346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afcb61-d558-4483-82e4-7b8b6b4a14c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:49.187648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afcb61-d558-4483-82e4-7b8b6b4a14c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:49.189015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afcb61-d558-4483-82e4-7b8b6b4a14c4 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:49.194607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:49.198332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 611/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:49.203546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8be62-992f-4bf9-a33f-69a2dbf38ffd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:49.276873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:49.307883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8be62-992f-4bf9-a33f-69a2dbf38ffd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:49.340417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7519ce2-e0a9-4a76-bdec-045412281002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:49.341043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519ce2-e0a9-4a76-bdec-045412281002 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:49.341323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519ce2-e0a9-4a76-bdec-045412281002 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:49.341597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519ce2-e0a9-4a76-bdec-045412281002 None admin] PATH_INFO: `/v3/users/ac33e2aaafd5411eaf1a6bb27c518166` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:49.342776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7519ce2-e0a9-4a76-bdec-045412281002 None admin] RBAC: Authorizing `identity:get_user(user_id=ac33e2aaafd5411eaf1a6bb27c518166)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:49.344206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7519ce2-e0a9-4a76-bdec-045412281002 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:49.345810 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 586/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Jul 28 01:57:49 2022] GET /identity/v3/users/ac33e2aaafd5411eaf1a6bb27c518166 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:49.352050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afcb61-d558-4483-82e4-7b8b6b4a14c4 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:49.448282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afcb61-d558-4483-82e4-7b8b6b4a14c4 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:49.480819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b3940-e42c-48f3-9fa8-c024701b4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:49.481405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b3940-e42c-48f3-9fa8-c024701b4fac None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:49.481678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b3940-e42c-48f3-9fa8-c024701b4fac None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:49.481946 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b3940-e42c-48f3-9fa8-c024701b4fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:49.543832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:49.546029 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b3940-e42c-48f3-9fa8-c024701b4fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:49.548042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b3940-e42c-48f3-9fa8-c024701b4fac None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:49.643408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 612/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:57:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:57:49.649658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7519ce2-e0a9-4a76-bdec-045412281002 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:49.747840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7519ce2-e0a9-4a76-bdec-045412281002 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:49.780022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd603a-7ebf-409f-8272-1d7cef21b8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:49.780644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd603a-7ebf-409f-8272-1d7cef21b8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:49.780923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd603a-7ebf-409f-8272-1d7cef21b8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:49.781197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd603a-7ebf-409f-8272-1d7cef21b8c3 None admin] PATH_INFO: `/v3/projects/6d9b533f5c16427f8293e5521f24ee78` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:49.782340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd603a-7ebf-409f-8272-1d7cef21b8c3 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9b533f5c16427f8293e5521f24ee78)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:49.783798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd603a-7ebf-409f-8272-1d7cef21b8c3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:49.785433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 587/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Jul 28 01:57:49 2022] GET /identity/v3/projects/6d9b533f5c16427f8293e5521f24ee78 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:49.792052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b3940-e42c-48f3-9fa8-c024701b4fac None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:57:49.884781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:49.888137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b3940-e42c-48f3-9fa8-c024701b4fac None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:57:49.921770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd4182-5cac-4b97-b887-516b32bf1392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:57:49.922344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd4182-5cac-4b97-b887-516b32bf1392 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:57:49.922667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd4182-5cac-4b97-b887-516b32bf1392 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:57:49.922940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd4182-5cac-4b97-b887-516b32bf1392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:57:49.923724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd4182-5cac-4b97-b887-516b32bf1392 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=6d9b533f5c16427f8293e5521f24ee78, user.id=ac33e2aaafd5411eaf1a6bb27c518166) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:57:49.924053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd4182-5cac-4b97-b887-516b32bf1392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:57:49.925455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd4182-5cac-4b97-b887-516b32bf1392 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:57:49.931101 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 613/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:57:49 2022] GET /identity/v3/role_assignments?user.id=ac33e2aaafd5411eaf1a6bb27c518166&scope.project.id=6d9b533f5c16427f8293e5521f24ee78&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:57:59.775941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:57:59.928562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=18 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:44.330195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3037e3-3aba-4dd1-80b2-7281746c2caf None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:44.330835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3037e3-3aba-4dd1-80b2-7281746c2caf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:44.330835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3037e3-3aba-4dd1-80b2-7281746c2caf None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:44.332124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 588/1201] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:58:44.337837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746a58-c081-4365-afe1-9a5d35fc9591 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:44.338334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746a58-c081-4365-afe1-9a5d35fc9591 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:44.338432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746a58-c081-4365-afe1-9a5d35fc9591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:44.366988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-72746a58-c081-4365-afe1-9a5d35fc9591 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:58:44.368498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-72746a58-c081-4365-afe1-9a5d35fc9591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:58:44.462470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 614/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:58:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:58:44.483021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3037e3-3aba-4dd1-80b2-7281746c2caf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:44.615103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3037e3-3aba-4dd1-80b2-7281746c2caf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:44.655826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e48cd2-2623-4251-ae9b-eb201e1d0adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:44.656494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e48cd2-2623-4251-ae9b-eb201e1d0adc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:44.656774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e48cd2-2623-4251-ae9b-eb201e1d0adc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:44.657040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e48cd2-2623-4251-ae9b-eb201e1d0adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:44.670689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e48cd2-2623-4251-ae9b-eb201e1d0adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:44.672152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e48cd2-2623-4251-ae9b-eb201e1d0adc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-33e48cd2-2623-4251-ae9b-eb201e1d0adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:58:44.689831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:44.690890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:44.692152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:58:44.692152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:58:44.692152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:44.692152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:58:44.694302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 589/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:44.701389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746a58-c081-4365-afe1-9a5d35fc9591 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:44.817622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746a58-c081-4365-afe1-9a5d35fc9591 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:44.866533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:44.879968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba9427-ae1a-479e-b595-9f85d62c0da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:44.880645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba9427-ae1a-479e-b595-9f85d62c0da6 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:44.880994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba9427-ae1a-479e-b595-9f85d62c0da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:44.881307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba9427-ae1a-479e-b595-9f85d62c0da6 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:44.882050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba9427-ae1a-479e-b595-9f85d62c0da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:44.882356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba9427-ae1a-479e-b595-9f85d62c0da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:44.883852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba9427-ae1a-479e-b595-9f85d62c0da6 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:44.897300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 615/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:44.903652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e48cd2-2623-4251-ae9b-eb201e1d0adc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:44.964740 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:45.022773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e48cd2-2623-4251-ae9b-eb201e1d0adc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:45.073548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37edb33-b735-4d91-b74e-45140c9bd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:45.074249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37edb33-b735-4d91-b74e-45140c9bd99c None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:45.074567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37edb33-b735-4d91-b74e-45140c9bd99c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:45.075006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37edb33-b735-4d91-b74e-45140c9bd99c None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:45.075803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37edb33-b735-4d91-b74e-45140c9bd99c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:45.077493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37edb33-b735-4d91-b74e-45140c9bd99c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:45.110493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 590/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Jul 28 01:58:44 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 01:58:47.405741 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901bb92-65a6-4d57-80ec-0d02a8e48016 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:47.406303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901bb92-65a6-4d57-80ec-0d02a8e48016 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:47.406303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901bb92-65a6-4d57-80ec-0d02a8e48016 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:47.408085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 616/1206] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:58:47.414846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f6b1-d13a-46f4-880b-eeff5b33e11a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:47.415278 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f6b1-d13a-46f4-880b-eeff5b33e11a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:47.415411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f6b1-d13a-46f4-880b-eeff5b33e11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:47.435874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1287f6b1-d13a-46f4-880b-eeff5b33e11a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:58:47.437598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1287f6b1-d13a-46f4-880b-eeff5b33e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:58:47.514404 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 591/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:58:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:58:47.536990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901bb92-65a6-4d57-80ec-0d02a8e48016 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:47.655114 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901bb92-65a6-4d57-80ec-0d02a8e48016 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:47.692949 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7573f4-baa9-4a48-9477-dba881abe849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:47.693493 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7573f4-baa9-4a48-9477-dba881abe849 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:47.693772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7573f4-baa9-4a48-9477-dba881abe849 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:47.694039 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7573f4-baa9-4a48-9477-dba881abe849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:47.705284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7573f4-baa9-4a48-9477-dba881abe849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-3b7573f4-baa9-4a48-9477-dba881abe849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:58:47.710266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:47.711353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:58:47.712246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 617/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:58:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:47.717879 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f6b1-d13a-46f4-880b-eeff5b33e11a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:47.766372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:47.841288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f6b1-d13a-46f4-880b-eeff5b33e11a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:47.883912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7369073-fcea-4436-9adf-e67e492fbdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:47.884536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7369073-fcea-4436-9adf-e67e492fbdab None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:47.884813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7369073-fcea-4436-9adf-e67e492fbdab None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:47.885084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7369073-fcea-4436-9adf-e67e492fbdab None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:47.885806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7369073-fcea-4436-9adf-e67e492fbdab None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:47.888271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7369073-fcea-4436-9adf-e67e492fbdab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:47.888271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7369073-fcea-4436-9adf-e67e492fbdab None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:47.896182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 592/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:58:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:47.902156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7573f4-baa9-4a48-9477-dba881abe849 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:47.958432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:48.016154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7573f4-baa9-4a48-9477-dba881abe849 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:48.065692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1e12a-f7d4-4d57-8ca6-20638b62e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:48.066336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1e12a-f7d4-4d57-8ca6-20638b62e198 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:48.066939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1e12a-f7d4-4d57-8ca6-20638b62e198 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:48.067406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1e12a-f7d4-4d57-8ca6-20638b62e198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:48.078181 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1e12a-f7d4-4d57-8ca6-20638b62e198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:48.080656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1e12a-f7d4-4d57-8ca6-20638b62e198 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-97d1e12a-f7d4-4d57-8ca6-20638b62e198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:58:48.095812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:48.097785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:48.099310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:58:48.099310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:58:48.099310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:48.099310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:58:48.099310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 618/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:48.104292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7369073-fcea-4436-9adf-e67e492fbdab None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:48.219498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:48.224636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7369073-fcea-4436-9adf-e67e492fbdab None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:48.265832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea12a0a-b6ec-4bec-b84d-38f67362c1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:48.266517 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea12a0a-b6ec-4bec-b84d-38f67362c1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:48.266780 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea12a0a-b6ec-4bec-b84d-38f67362c1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:48.267050 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea12a0a-b6ec-4bec-b84d-38f67362c1b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:48.267732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea12a0a-b6ec-4bec-b84d-38f67362c1b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:48.268036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea12a0a-b6ec-4bec-b84d-38f67362c1b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:48.269395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea12a0a-b6ec-4bec-b84d-38f67362c1b3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:48.284052 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 593/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:48.290176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1e12a-f7d4-4d57-8ca6-20638b62e198 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:48.414290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1e12a-f7d4-4d57-8ca6-20638b62e198 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:48.415885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:48.453366 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ddbb6-0d94-4ac6-af84-ffb1378f14d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:48.454070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ddbb6-0d94-4ac6-af84-ffb1378f14d0 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:48.454422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ddbb6-0d94-4ac6-af84-ffb1378f14d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:48.454672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ddbb6-0d94-4ac6-af84-ffb1378f14d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:48.463448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ddbb6-0d94-4ac6-af84-ffb1378f14d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:48.465077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ddbb6-0d94-4ac6-af84-ffb1378f14d0 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-891ddbb6-0d94-4ac6-af84-ffb1378f14d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:58:48.477828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:48.479006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:48.479980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:48.479980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:48.479980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:58:48.479980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:58:48.479980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:58:48.479980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:58:48.479980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:58:48.479980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:58:48.479980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:58:48.479980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:58:48.480765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 619/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:58:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:48.486089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea12a0a-b6ec-4bec-b84d-38f67362c1b3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:48.604496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea12a0a-b6ec-4bec-b84d-38f67362c1b3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:48.649236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866009f-bc56-4cee-8c86-c26ff4b2488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:48.650027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866009f-bc56-4cee-8c86-c26ff4b2488b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:48.650329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866009f-bc56-4cee-8c86-c26ff4b2488b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:48.650631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866009f-bc56-4cee-8c86-c26ff4b2488b None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:48.651625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866009f-bc56-4cee-8c86-c26ff4b2488b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:48.652012 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866009f-bc56-4cee-8c86-c26ff4b2488b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:48.653797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866009f-bc56-4cee-8c86-c26ff4b2488b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:48.677300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 594/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jul 28 01:58:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 01:58:48.684337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ddbb6-0d94-4ac6-af84-ffb1378f14d0 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:48.810312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ddbb6-0d94-4ac6-af84-ffb1378f14d0 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:48.848994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d2f93-bb9e-4982-832b-1dc34f8a88fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:48.849762 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d2f93-bb9e-4982-832b-1dc34f8a88fe None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:48.850046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d2f93-bb9e-4982-832b-1dc34f8a88fe None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:48.850464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d2f93-bb9e-4982-832b-1dc34f8a88fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:48.886628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:48.936580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d2f93-bb9e-4982-832b-1dc34f8a88fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:48.938075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d2f93-bb9e-4982-832b-1dc34f8a88fe None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:49.083858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 620/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:58:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:58:49.089449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866009f-bc56-4cee-8c86-c26ff4b2488b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:49.110891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:49.214939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866009f-bc56-4cee-8c86-c26ff4b2488b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:49.259852 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db1f2e-e941-4ade-9cd9-4fc85a7d6ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:49.260515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db1f2e-e941-4ade-9cd9-4fc85a7d6ced None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:49.260904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db1f2e-e941-4ade-9cd9-4fc85a7d6ced None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:49.261248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db1f2e-e941-4ade-9cd9-4fc85a7d6ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:49.274947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db1f2e-e941-4ade-9cd9-4fc85a7d6ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:49.276398 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db1f2e-e941-4ade-9cd9-4fc85a7d6ced None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-28db1f2e-e941-4ade-9cd9-4fc85a7d6ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:58:49.291910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:49.293022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:49.294110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:58:49.294110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:58:49.294110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:49.294110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:58:49.298857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 595/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:49.301823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d2f93-bb9e-4982-832b-1dc34f8a88fe None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:49.366053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:49.419915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d2f93-bb9e-4982-832b-1dc34f8a88fe None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:49.459808 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98758945-ce4e-400e-b483-ed1b9d87f2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:49.460438 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98758945-ce4e-400e-b483-ed1b9d87f2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:49.460715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98758945-ce4e-400e-b483-ed1b9d87f2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:49.460990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98758945-ce4e-400e-b483-ed1b9d87f2b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:49.461696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98758945-ce4e-400e-b483-ed1b9d87f2b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:49.461997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98758945-ce4e-400e-b483-ed1b9d87f2b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:49.463412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98758945-ce4e-400e-b483-ed1b9d87f2b5 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:49.477769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 621/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:49.483337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db1f2e-e941-4ade-9cd9-4fc85a7d6ced None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:49.568169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:49.600803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db1f2e-e941-4ade-9cd9-4fc85a7d6ced None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:49.638759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e802b75-e5b7-42e2-9f3f-d71f878d89ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:49.639350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e802b75-e5b7-42e2-9f3f-d71f878d89ce None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:49.639634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e802b75-e5b7-42e2-9f3f-d71f878d89ce None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:49.639933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e802b75-e5b7-42e2-9f3f-d71f878d89ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:49.647893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e802b75-e5b7-42e2-9f3f-d71f878d89ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:49.649593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e802b75-e5b7-42e2-9f3f-d71f878d89ce None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8e802b75-e5b7-42e2-9f3f-d71f878d89ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:58:49.663769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:49.664837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:49.665722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:58:49.665722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:58:49.665722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:58:49.665722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:58:49.665722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:58:49.665722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:58:49.665722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:58:49.665722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:58:49.665722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 596/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:49.671602 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98758945-ce4e-400e-b483-ed1b9d87f2b5 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:49.784199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98758945-ce4e-400e-b483-ed1b9d87f2b5 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:49.809126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:49.822748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b243d-5252-4e0c-97ce-232c124c019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:49.823368 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b243d-5252-4e0c-97ce-232c124c019b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:49.823645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b243d-5252-4e0c-97ce-232c124c019b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:49.823920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b243d-5252-4e0c-97ce-232c124c019b None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:49.824667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b243d-5252-4e0c-97ce-232c124c019b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:49.824983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b243d-5252-4e0c-97ce-232c124c019b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:49.826407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b243d-5252-4e0c-97ce-232c124c019b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:49.840053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 622/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:58:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:49.845798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e802b75-e5b7-42e2-9f3f-d71f878d89ce None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:49.986190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e802b75-e5b7-42e2-9f3f-d71f878d89ce None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:50.026967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:50.037064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735660b-5349-47f1-8d3b-5a7fc057400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:50.037766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735660b-5349-47f1-8d3b-5a7fc057400e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:50.038108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735660b-5349-47f1-8d3b-5a7fc057400e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:50.038475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735660b-5349-47f1-8d3b-5a7fc057400e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:50.039333 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735660b-5349-47f1-8d3b-5a7fc057400e None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=e041d38c69cd4626898bc1412f5ed1d4) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:50.039733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735660b-5349-47f1-8d3b-5a7fc057400e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:50.041220 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735660b-5349-47f1-8d3b-5a7fc057400e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:50.058948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 597/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:58:49 2022] GET /identity/v3/role_assignments?user.id=e041d38c69cd4626898bc1412f5ed1d4&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:52.141855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98df3ce-178b-4362-9c16-68565cdfd5ce None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:52.142385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98df3ce-178b-4362-9c16-68565cdfd5ce None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:52.142531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98df3ce-178b-4362-9c16-68565cdfd5ce None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:52.144156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 623/1220] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:58:52.149988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d93cd-d80f-4d53-8bf8-bbe0f6b1583c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:52.150416 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d93cd-d80f-4d53-8bf8-bbe0f6b1583c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:52.150574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d93cd-d80f-4d53-8bf8-bbe0f6b1583c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:52.168523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-497d93cd-d80f-4d53-8bf8-bbe0f6b1583c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:58:52.169723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-497d93cd-d80f-4d53-8bf8-bbe0f6b1583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:58:52.237032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 598/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:58:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:58:52.259188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98df3ce-178b-4362-9c16-68565cdfd5ce None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:52.367388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98df3ce-178b-4362-9c16-68565cdfd5ce None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:52.404274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca587cd-4c98-4c8d-98b4-cb18f98c7a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:52.405016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca587cd-4c98-4c8d-98b4-cb18f98c7a47 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:52.405321 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca587cd-4c98-4c8d-98b4-cb18f98c7a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:52.405693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca587cd-4c98-4c8d-98b4-cb18f98c7a47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:52.420066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca587cd-4c98-4c8d-98b4-cb18f98c7a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-fca587cd-4c98-4c8d-98b4-cb18f98c7a47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:58:52.425019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:52.426243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:58:52.427810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 624/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:58:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:52.432785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d93cd-d80f-4d53-8bf8-bbe0f6b1583c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:52.533673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d93cd-d80f-4d53-8bf8-bbe0f6b1583c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:52.562300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:52.575967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f5eda-e873-4d98-8ad6-6db701b49d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:52.576795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f5eda-e873-4d98-8ad6-6db701b49d9d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:52.577164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f5eda-e873-4d98-8ad6-6db701b49d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:52.577553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f5eda-e873-4d98-8ad6-6db701b49d9d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:52.578390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f5eda-e873-4d98-8ad6-6db701b49d9d None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:52.578904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f5eda-e873-4d98-8ad6-6db701b49d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:52.580543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f5eda-e873-4d98-8ad6-6db701b49d9d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:52.590544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 599/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:58:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:52.596434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca587cd-4c98-4c8d-98b4-cb18f98c7a47 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:52.649658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:52.714586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca587cd-4c98-4c8d-98b4-cb18f98c7a47 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:52.751972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c65e4-705a-4ff4-8ad7-d34fbf5bc853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:52.752953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c65e4-705a-4ff4-8ad7-d34fbf5bc853 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:52.753267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c65e4-705a-4ff4-8ad7-d34fbf5bc853 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:52.753643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c65e4-705a-4ff4-8ad7-d34fbf5bc853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:52.764862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c65e4-705a-4ff4-8ad7-d34fbf5bc853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:52.766583 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c65e4-705a-4ff4-8ad7-d34fbf5bc853 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-a57c65e4-705a-4ff4-8ad7-d34fbf5bc853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:58:52.784036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:52.785171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:52.786714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:58:52.786714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:58:52.786714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:52.786714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:58:52.786714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 625/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:52.791891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f5eda-e873-4d98-8ad6-6db701b49d9d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:52.901336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f5eda-e873-4d98-8ad6-6db701b49d9d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:52.936645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08e2fe-31aa-411b-8932-e95ea5c73911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:52.937257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08e2fe-31aa-411b-8932-e95ea5c73911 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:52.937539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08e2fe-31aa-411b-8932-e95ea5c73911 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:52.937814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08e2fe-31aa-411b-8932-e95ea5c73911 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:52.938540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08e2fe-31aa-411b-8932-e95ea5c73911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:52.938850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08e2fe-31aa-411b-8932-e95ea5c73911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:52.940219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08e2fe-31aa-411b-8932-e95ea5c73911 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:52.954308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 600/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:52.960925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c65e4-705a-4ff4-8ad7-d34fbf5bc853 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:53.063249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:53.071260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c65e4-705a-4ff4-8ad7-d34fbf5bc853 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:53.110882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61da3-44a0-41e4-b338-961d179e2320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:53.111637 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61da3-44a0-41e4-b338-961d179e2320 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:53.111916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61da3-44a0-41e4-b338-961d179e2320 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:53.112213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61da3-44a0-41e4-b338-961d179e2320 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:53.121074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d61da3-44a0-41e4-b338-961d179e2320 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:53.122751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d61da3-44a0-41e4-b338-961d179e2320 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-63d61da3-44a0-41e4-b338-961d179e2320 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:58:53.134646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:53.135798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:58:53.136754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 626/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:58:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:53.142279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08e2fe-31aa-411b-8932-e95ea5c73911 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:53.195129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:53.262877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08e2fe-31aa-411b-8932-e95ea5c73911 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:53.300277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6b220-bca8-46ce-b554-d7aa894a2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:53.300890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6b220-bca8-46ce-b554-d7aa894a2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:53.301331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6b220-bca8-46ce-b554-d7aa894a2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:53.301659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6b220-bca8-46ce-b554-d7aa894a2cd4 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:53.302454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6b220-bca8-46ce-b554-d7aa894a2cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:53.302753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6b220-bca8-46ce-b554-d7aa894a2cd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:53.304188 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6b220-bca8-46ce-b554-d7aa894a2cd4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:53.326540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 601/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jul 28 01:58:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:53.331453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61da3-44a0-41e4-b338-961d179e2320 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:53.442255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61da3-44a0-41e4-b338-961d179e2320 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:53.480113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75f23-cc39-401b-b63e-312ad1123fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:53.480750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75f23-cc39-401b-b63e-312ad1123fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:53.481028 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75f23-cc39-401b-b63e-312ad1123fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:53.481301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75f23-cc39-401b-b63e-312ad1123fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:53.493371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb75f23-cc39-401b-b63e-312ad1123fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:53.494906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb75f23-cc39-401b-b63e-312ad1123fd3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-2cb75f23-cc39-401b-b63e-312ad1123fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:58:53.510416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:53.511359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:53.512246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:58:53.512246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:58:53.512246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:53.512246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:58:53.512246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 627/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:53.517462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6b220-bca8-46ce-b554-d7aa894a2cd4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:53.633232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6b220-bca8-46ce-b554-d7aa894a2cd4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:53.635974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:53.673148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f511862-11c5-4f3e-89a6-da7c44c30b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:53.673792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f511862-11c5-4f3e-89a6-da7c44c30b77 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:53.674071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f511862-11c5-4f3e-89a6-da7c44c30b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:53.674405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f511862-11c5-4f3e-89a6-da7c44c30b77 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:53.675064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f511862-11c5-4f3e-89a6-da7c44c30b77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:53.675365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f511862-11c5-4f3e-89a6-da7c44c30b77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:53.676710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f511862-11c5-4f3e-89a6-da7c44c30b77 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:53.688216 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 602/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:53.694824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75f23-cc39-401b-b63e-312ad1123fd3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:53.705285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:53.799742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75f23-cc39-401b-b63e-312ad1123fd3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:53.835923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f78b3b-67b9-4272-a7d1-7dc27d7b0164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:53.836555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f78b3b-67b9-4272-a7d1-7dc27d7b0164 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:53.836835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f78b3b-67b9-4272-a7d1-7dc27d7b0164 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:53.837109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f78b3b-67b9-4272-a7d1-7dc27d7b0164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:53.844121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f78b3b-67b9-4272-a7d1-7dc27d7b0164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:53.845624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f78b3b-67b9-4272-a7d1-7dc27d7b0164 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-f5f78b3b-67b9-4272-a7d1-7dc27d7b0164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:58:53.857183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:53.858773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:53.860288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:58:53.860288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:58:53.860288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:58:53.860288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:58:53.860288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:58:53.860288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:58:53.860288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:58:53.860288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:58:53.860288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 628/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:53.864176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f511862-11c5-4f3e-89a6-da7c44c30b77 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:53.973101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f511862-11c5-4f3e-89a6-da7c44c30b77 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:54.009927 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2c905-cf11-4ce1-9e3a-f2c1e5ba91b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:54.010585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c905-cf11-4ce1-9e3a-f2c1e5ba91b5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:54.010867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c905-cf11-4ce1-9e3a-f2c1e5ba91b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:54.011143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c905-cf11-4ce1-9e3a-f2c1e5ba91b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:54.011935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2c905-cf11-4ce1-9e3a-f2c1e5ba91b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:54.012225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2c905-cf11-4ce1-9e3a-f2c1e5ba91b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:54.013649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2c905-cf11-4ce1-9e3a-f2c1e5ba91b5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:54.027682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 603/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:54.033970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f78b3b-67b9-4272-a7d1-7dc27d7b0164 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:54.101070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:54.143890 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f78b3b-67b9-4272-a7d1-7dc27d7b0164 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:54.181319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677becc-f68f-4563-949f-167a166bcaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:54.182111 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677becc-f68f-4563-949f-167a166bcaff None admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:54.182358 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677becc-f68f-4563-949f-167a166bcaff None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:54.182655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677becc-f68f-4563-949f-167a166bcaff None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/e041d38c69cd4626898bc1412f5ed1d4/roles/d8f52393c9554176af3cc338302d1302` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:54.197720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677becc-f68f-4563-949f-167a166bcaff None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=e041d38c69cd4626898bc1412f5ed1d4, role_id=d8f52393c9554176af3cc338302d1302)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:54.199202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677becc-f68f-4563-949f-167a166bcaff None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:54.217533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 629/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:58:54 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/e041d38c69cd4626898bc1412f5ed1d4/roles/d8f52393c9554176af3cc338302d1302 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:58:56.422345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69a9d9-b080-42f2-a21f-5b9b49b5c576 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:56.422963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69a9d9-b080-42f2-a21f-5b9b49b5c576 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:56.423071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69a9d9-b080-42f2-a21f-5b9b49b5c576 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:56.424401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 604/1233] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:58:56.430687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389f02c-436b-40ba-a1e3-f5cbdcd4891d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:56.431222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389f02c-436b-40ba-a1e3-f5cbdcd4891d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:56.431222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389f02c-436b-40ba-a1e3-f5cbdcd4891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:56.452217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-6389f02c-436b-40ba-a1e3-f5cbdcd4891d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:58:56.453634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6389f02c-436b-40ba-a1e3-f5cbdcd4891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:58:56.531736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 630/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:58:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 01:58:56.558693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69a9d9-b080-42f2-a21f-5b9b49b5c576 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:56.588184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:56.680303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69a9d9-b080-42f2-a21f-5b9b49b5c576 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:56.719230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a4dc0-bdb7-40ab-a608-a2baa30a66a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:56.719956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a4dc0-bdb7-40ab-a608-a2baa30a66a5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:56.720239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a4dc0-bdb7-40ab-a608-a2baa30a66a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:56.720523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a4dc0-bdb7-40ab-a608-a2baa30a66a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:56.733467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a4dc0-bdb7-40ab-a608-a2baa30a66a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-542a4dc0-bdb7-40ab-a608-a2baa30a66a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:58:56.738350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:56.739880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:58:56.740894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 605/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Jul 28 01:58:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:56.748408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389f02c-436b-40ba-a1e3-f5cbdcd4891d None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:56.805082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:56.864855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389f02c-436b-40ba-a1e3-f5cbdcd4891d None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:56.900658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f9cf6-bbac-4326-aa10-2e37fe724300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:56.901274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f9cf6-bbac-4326-aa10-2e37fe724300 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:56.901556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f9cf6-bbac-4326-aa10-2e37fe724300 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:56.901829 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f9cf6-bbac-4326-aa10-2e37fe724300 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:56.902578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f9cf6-bbac-4326-aa10-2e37fe724300 None admin] RBAC: Adding query filter params (name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:56.902882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f9cf6-bbac-4326-aa10-2e37fe724300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:56.904251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f9cf6-bbac-4326-aa10-2e37fe724300 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:56.913555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 631/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Jul 28 01:58:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:56.919461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a4dc0-bdb7-40ab-a608-a2baa30a66a5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:57.008301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:57.026681 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a4dc0-bdb7-40ab-a608-a2baa30a66a5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:57.064979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c421b-d46f-4cf8-8156-7eee4fbb9a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:57.065603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c421b-d46f-4cf8-8156-7eee4fbb9a16 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:57.065883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c421b-d46f-4cf8-8156-7eee4fbb9a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:57.066157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c421b-d46f-4cf8-8156-7eee4fbb9a16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:57.076501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c421b-d46f-4cf8-8156-7eee4fbb9a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:57.077972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c421b-d46f-4cf8-8156-7eee4fbb9a16 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-db4c421b-d46f-4cf8-8156-7eee4fbb9a16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:58:57.093125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:57.094328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:57.095831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:58:57.095831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:58:57.095831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:57.095831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:58:57.095831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 606/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:57.100723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f9cf6-bbac-4326-aa10-2e37fe724300 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:57.204631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f9cf6-bbac-4326-aa10-2e37fe724300 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:57.214909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:57.241464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b390a0-4c00-4c4a-a1e9-0d53afcc4d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:57.242084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b390a0-4c00-4c4a-a1e9-0d53afcc4d19 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:57.242394 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b390a0-4c00-4c4a-a1e9-0d53afcc4d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:57.242851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b390a0-4c00-4c4a-a1e9-0d53afcc4d19 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:57.243551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b390a0-4c00-4c4a-a1e9-0d53afcc4d19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:57.243895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b390a0-4c00-4c4a-a1e9-0d53afcc4d19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:57.245302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b390a0-4c00-4c4a-a1e9-0d53afcc4d19 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:57.257545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 632/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:57.263345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c421b-d46f-4cf8-8156-7eee4fbb9a16 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:57.372486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c421b-d46f-4cf8-8156-7eee4fbb9a16 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:57.413911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ef722-27b2-4e32-96aa-70f2b7d9cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:57.414664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef722-27b2-4e32-96aa-70f2b7d9cf90 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:57.415009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef722-27b2-4e32-96aa-70f2b7d9cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:57.415298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef722-27b2-4e32-96aa-70f2b7d9cf90 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:57.418481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:57.425358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ef722-27b2-4e32-96aa-70f2b7d9cf90 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:57.426975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ef722-27b2-4e32-96aa-70f2b7d9cf90 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-891ef722-27b2-4e32-96aa-70f2b7d9cf90 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:58:57.439675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:57.440731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:58:57.443118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 607/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:58:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:57.451123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b390a0-4c00-4c4a-a1e9-0d53afcc4d19 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:57.555451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b390a0-4c00-4c4a-a1e9-0d53afcc4d19 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:57.593974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3c3e2-b7fe-4f83-bf9c-658d11fb67c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:57.594618 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c3e2-b7fe-4f83-bf9c-658d11fb67c3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:57.594895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c3e2-b7fe-4f83-bf9c-658d11fb67c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:57.595162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c3e2-b7fe-4f83-bf9c-658d11fb67c3 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:57.595961 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3c3e2-b7fe-4f83-bf9c-658d11fb67c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:57.596267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3c3e2-b7fe-4f83-bf9c-658d11fb67c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:57.597690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3c3e2-b7fe-4f83-bf9c-658d11fb67c3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:57.617302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 633/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jul 28 01:58:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:57.626163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ef722-27b2-4e32-96aa-70f2b7d9cf90 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:57.739085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ef722-27b2-4e32-96aa-70f2b7d9cf90 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:57.781260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1fe5-0062-4be6-be7a-cf609c40a59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:57.781889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1fe5-0062-4be6-be7a-cf609c40a59d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:57.782164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1fe5-0062-4be6-be7a-cf609c40a59d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:57.782431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1fe5-0062-4be6-be7a-cf609c40a59d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:57.859454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:57.866662 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1fe5-0062-4be6-be7a-cf609c40a59d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:57.868131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1fe5-0062-4be6-be7a-cf609c40a59d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:57.977177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 608/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:58:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 01:58:57.983163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3c3e2-b7fe-4f83-bf9c-658d11fb67c3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:58.015626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:58.096395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3c3e2-b7fe-4f83-bf9c-658d11fb67c3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:58.132163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14751f0b-7613-4fa5-9c26-5703b888b623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:58.132755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14751f0b-7613-4fa5-9c26-5703b888b623 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:58.133108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14751f0b-7613-4fa5-9c26-5703b888b623 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:58.133383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14751f0b-7613-4fa5-9c26-5703b888b623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:58.144119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14751f0b-7613-4fa5-9c26-5703b888b623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:58.145617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14751f0b-7613-4fa5-9c26-5703b888b623 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-14751f0b-7613-4fa5-9c26-5703b888b623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:58:58.162266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:58.163353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:58.164288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:58:58.164288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:58:58.164288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:58:58.164288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:58:58.166606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 634/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:58:58.169769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1fe5-0062-4be6-be7a-cf609c40a59d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:58.266740 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:58.272738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1fe5-0062-4be6-be7a-cf609c40a59d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:58.308555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ef677-5edd-4be4-83a0-d40b55e9135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:58.309177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ef677-5edd-4be4-83a0-d40b55e9135c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:58.309456 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ef677-5edd-4be4-83a0-d40b55e9135c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:58.309732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ef677-5edd-4be4-83a0-d40b55e9135c None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:58.310482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ef677-5edd-4be4-83a0-d40b55e9135c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:58.310785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ef677-5edd-4be4-83a0-d40b55e9135c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:58.312282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ef677-5edd-4be4-83a0-d40b55e9135c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:58.326253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 609/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:58.332576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14751f0b-7613-4fa5-9c26-5703b888b623 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:58.428710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:58:58.452163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14751f0b-7613-4fa5-9c26-5703b888b623 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:58.489280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9093b-f02b-48f0-9ec3-d8d6de743afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:58.489969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9093b-f02b-48f0-9ec3-d8d6de743afc None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:58.490269 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9093b-f02b-48f0-9ec3-d8d6de743afc None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:58.490580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9093b-f02b-48f0-9ec3-d8d6de743afc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:58.497668 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9093b-f02b-48f0-9ec3-d8d6de743afc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:58.499226 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9093b-f02b-48f0-9ec3-d8d6de743afc None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-52c9093b-f02b-48f0-9ec3-d8d6de743afc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:58:58.511453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:58:58.512677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:58:58.513763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:58:58.513763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:58:58.513763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:58:58.513763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:58:58.513763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:58:58.513763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:58:58.513763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:58:58.513763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:58:58.513763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 635/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:58:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:58:58.518684 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ef677-5edd-4be4-83a0-d40b55e9135c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:58.630828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ef677-5edd-4be4-83a0-d40b55e9135c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:58.667648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8e8eb-4be5-4e34-ac9a-3dc112bce839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:58.668270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8e8eb-4be5-4e34-ac9a-3dc112bce839 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:58.668549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8e8eb-4be5-4e34-ac9a-3dc112bce839 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:58.668823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8e8eb-4be5-4e34-ac9a-3dc112bce839 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:58.669565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8e8eb-4be5-4e34-ac9a-3dc112bce839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:58.669897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8e8eb-4be5-4e34-ac9a-3dc112bce839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:58.671334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8e8eb-4be5-4e34-ac9a-3dc112bce839 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:58.684757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 610/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:58:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:58:58.691248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9093b-f02b-48f0-9ec3-d8d6de743afc None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:58:58.812887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9093b-f02b-48f0-9ec3-d8d6de743afc None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:58:58.851662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3a98c-4061-43a0-aecd-78026177e1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:58:58.852353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a98c-4061-43a0-aecd-78026177e1cc None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:58:58.852662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a98c-4061-43a0-aecd-78026177e1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:58:58.852939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a98c-4061-43a0-aecd-78026177e1cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:58:58.853816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3a98c-4061-43a0-aecd-78026177e1cc None admin] RBAC: Adding query filter params (role.id=d8f52393c9554176af3cc338302d1302, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=e041d38c69cd4626898bc1412f5ed1d4) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:58:58.854130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3a98c-4061-43a0-aecd-78026177e1cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:58:58.855737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3a98c-4061-43a0-aecd-78026177e1cc None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:58:58.865882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 636/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:58:58 2022] GET /identity/v3/role_assignments?user.id=e041d38c69cd4626898bc1412f5ed1d4&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=d8f52393c9554176af3cc338302d1302 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:01.101528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130dc2-fa7b-4af2-9af5-90a12fa62a45 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:01.102047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130dc2-fa7b-4af2-9af5-90a12fa62a45 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:01.102047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130dc2-fa7b-4af2-9af5-90a12fa62a45 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:01.103498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 611/1247] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:59:01.109988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c517f-33d9-4d71-8f7f-9bd38fea52d9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:01.110429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c517f-33d9-4d71-8f7f-9bd38fea52d9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:01.110556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c517f-33d9-4d71-8f7f-9bd38fea52d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:01.117606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:01.130566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-401c517f-33d9-4d71-8f7f-9bd38fea52d9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:59:01.131684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-401c517f-33d9-4d71-8f7f-9bd38fea52d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:59:01.203114 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 637/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:59:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:59:01.228538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130dc2-fa7b-4af2-9af5-90a12fa62a45 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:01.248307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:01.345722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130dc2-fa7b-4af2-9af5-90a12fa62a45 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:01.388887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576408d9-86d6-4a2e-9b3c-282f8280ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:01.389578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576408d9-86d6-4a2e-9b3c-282f8280ce1b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:01.389897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576408d9-86d6-4a2e-9b3c-282f8280ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:01.390169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576408d9-86d6-4a2e-9b3c-282f8280ce1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:01.408073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576408d9-86d6-4a2e-9b3c-282f8280ce1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-576408d9-86d6-4a2e-9b3c-282f8280ce1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:59:01.417243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:01.418425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:59:01.423789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 612/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:01.425729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c517f-33d9-4d71-8f7f-9bd38fea52d9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:01.545768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c517f-33d9-4d71-8f7f-9bd38fea52d9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:01.581229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:01.587485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502a13b-c969-4758-8d74-bc812d423dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:01.588261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a13b-c969-4758-8d74-bc812d423dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:01.588544 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a13b-c969-4758-8d74-bc812d423dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:01.588824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a13b-c969-4758-8d74-bc812d423dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:01.589690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502a13b-c969-4758-8d74-bc812d423dd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:01.589978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502a13b-c969-4758-8d74-bc812d423dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:01.591974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502a13b-c969-4758-8d74-bc812d423dd3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:01.608300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 638/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:01.609868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576408d9-86d6-4a2e-9b3c-282f8280ce1b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:01.716030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:01.742615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576408d9-86d6-4a2e-9b3c-282f8280ce1b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:01.784949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b9bc2-1fd3-4869-be75-99b4b9382a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:01.784949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b9bc2-1fd3-4869-be75-99b4b9382a75 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:01.784949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b9bc2-1fd3-4869-be75-99b4b9382a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:01.784949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b9bc2-1fd3-4869-be75-99b4b9382a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:01.796498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b9bc2-1fd3-4869-be75-99b4b9382a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:01.798006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b9bc2-1fd3-4869-be75-99b4b9382a75 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d45b9bc2-1fd3-4869-be75-99b4b9382a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:59:01.813746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:01.818599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:01.819723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:59:01.819723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:59:01.819723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:01.819723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:59:01.819723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 613/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:01.821709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502a13b-c969-4758-8d74-bc812d423dd3 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:01.933441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502a13b-c969-4758-8d74-bc812d423dd3 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:01.971123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6905d6-cdb9-4a97-bbf0-a1ba9cacaecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:01.971664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6905d6-cdb9-4a97-bbf0-a1ba9cacaecb None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:01.971941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6905d6-cdb9-4a97-bbf0-a1ba9cacaecb None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:01.972347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6905d6-cdb9-4a97-bbf0-a1ba9cacaecb None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:01.973622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6905d6-cdb9-4a97-bbf0-a1ba9cacaecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:01.973929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6905d6-cdb9-4a97-bbf0-a1ba9cacaecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:01.975457 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6905d6-cdb9-4a97-bbf0-a1ba9cacaecb None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:01.993445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 639/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:01.994770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b9bc2-1fd3-4869-be75-99b4b9382a75 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:02.107848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b9bc2-1fd3-4869-be75-99b4b9382a75 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:02.136003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:02.144207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34343920-ae37-4485-9dd4-32c2a3b84332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:02.144883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343920-ae37-4485-9dd4-32c2a3b84332 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:02.145236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343920-ae37-4485-9dd4-32c2a3b84332 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:02.145523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343920-ae37-4485-9dd4-32c2a3b84332 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:02.153221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34343920-ae37-4485-9dd4-32c2a3b84332 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:02.154685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34343920-ae37-4485-9dd4-32c2a3b84332 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-34343920-ae37-4485-9dd4-32c2a3b84332 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:59:02.166263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:02.167499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:59:02.168756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 614/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:59:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:02.173216 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6905d6-cdb9-4a97-bbf0-a1ba9cacaecb None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:02.235912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:02.288730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6905d6-cdb9-4a97-bbf0-a1ba9cacaecb None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:02.327441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823f19f-309f-4fb7-862f-eaa908809698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:02.328067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823f19f-309f-4fb7-862f-eaa908809698 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:02.328390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823f19f-309f-4fb7-862f-eaa908809698 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:02.328721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823f19f-309f-4fb7-862f-eaa908809698 None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:02.329577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823f19f-309f-4fb7-862f-eaa908809698 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:02.329900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823f19f-309f-4fb7-862f-eaa908809698 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:02.331552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823f19f-309f-4fb7-862f-eaa908809698 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:02.351584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 640/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jul 28 01:59:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:02.357433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34343920-ae37-4485-9dd4-32c2a3b84332 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:02.465390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34343920-ae37-4485-9dd4-32c2a3b84332 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:02.502574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f156d-73ac-4390-8e8f-05b792105bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:02.503217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f156d-73ac-4390-8e8f-05b792105bea None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:02.503535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f156d-73ac-4390-8e8f-05b792105bea None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:02.503830 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f156d-73ac-4390-8e8f-05b792105bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:02.564427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:02.578267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f156d-73ac-4390-8e8f-05b792105bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:02.579777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f156d-73ac-4390-8e8f-05b792105bea None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:02.691123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 615/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:59:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:59:02.699510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823f19f-309f-4fb7-862f-eaa908809698 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:02.822109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823f19f-309f-4fb7-862f-eaa908809698 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:02.840160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:02.863060 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f962035-1a86-48b1-937d-35a17150dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:02.863819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962035-1a86-48b1-937d-35a17150dad7 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:02.864173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962035-1a86-48b1-937d-35a17150dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:02.864519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962035-1a86-48b1-937d-35a17150dad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:02.875150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f962035-1a86-48b1-937d-35a17150dad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:02.876746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f962035-1a86-48b1-937d-35a17150dad7 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-7f962035-1a86-48b1-937d-35a17150dad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:59:02.892447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:02.893617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:02.894673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:59:02.894673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:59:02.894673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:02.894673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:02.894673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 641/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:59:02.900159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f156d-73ac-4390-8e8f-05b792105bea None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:02.995972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:03.010317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f156d-73ac-4390-8e8f-05b792105bea None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:03.046696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27609c-d026-4020-8bdd-9b4d8a97e717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:03.047865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27609c-d026-4020-8bdd-9b4d8a97e717 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:03.048148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27609c-d026-4020-8bdd-9b4d8a97e717 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:03.048552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27609c-d026-4020-8bdd-9b4d8a97e717 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:03.049243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27609c-d026-4020-8bdd-9b4d8a97e717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:03.049577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27609c-d026-4020-8bdd-9b4d8a97e717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:03.051600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27609c-d026-4020-8bdd-9b4d8a97e717 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:03.069635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 616/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:03.078083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f962035-1a86-48b1-937d-35a17150dad7 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:03.185051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f962035-1a86-48b1-937d-35a17150dad7 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:03.222599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b45e4-702a-4d50-a174-cfa955b14415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:03.223508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b45e4-702a-4d50-a174-cfa955b14415 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:03.223920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b45e4-702a-4d50-a174-cfa955b14415 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:03.224222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b45e4-702a-4d50-a174-cfa955b14415 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:03.232744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b45e4-702a-4d50-a174-cfa955b14415 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:03.234356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b45e4-702a-4d50-a174-cfa955b14415 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-7a3b45e4-702a-4d50-a174-cfa955b14415 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:59:03.247535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:03.248626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:03.249793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:59:03.249793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:59:03.249793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:59:03.249793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:59:03.249793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:59:03.249793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:59:03.249793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:59:03.249793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:03.254693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 642/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:59:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:03.255663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27609c-d026-4020-8bdd-9b4d8a97e717 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:03.364182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27609c-d026-4020-8bdd-9b4d8a97e717 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:03.398794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc968bb3-67bd-4f16-9fd7-17a214ea9624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:03.399411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc968bb3-67bd-4f16-9fd7-17a214ea9624 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:03.399680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc968bb3-67bd-4f16-9fd7-17a214ea9624 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:03.400010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc968bb3-67bd-4f16-9fd7-17a214ea9624 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:03.400744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc968bb3-67bd-4f16-9fd7-17a214ea9624 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:03.401042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc968bb3-67bd-4f16-9fd7-17a214ea9624 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:03.402499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc968bb3-67bd-4f16-9fd7-17a214ea9624 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:03.416525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 617/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:59:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:03.423110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b45e4-702a-4d50-a174-cfa955b14415 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:03.452434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:03.531607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b45e4-702a-4d50-a174-cfa955b14415 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:03.569049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399e9b6-51b4-4b97-937a-9fee8c4c6789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:03.569671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399e9b6-51b4-4b97-937a-9fee8c4c6789 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:03.569947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399e9b6-51b4-4b97-937a-9fee8c4c6789 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:03.570222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399e9b6-51b4-4b97-937a-9fee8c4c6789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:03.571203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399e9b6-51b4-4b97-937a-9fee8c4c6789 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=e041d38c69cd4626898bc1412f5ed1d4) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:03.571511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399e9b6-51b4-4b97-937a-9fee8c4c6789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:03.573079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399e9b6-51b4-4b97-937a-9fee8c4c6789 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:03.579332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 643/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:59:03 2022] GET /identity/v3/role_assignments?user.id=e041d38c69cd4626898bc1412f5ed1d4&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:05.558233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f4c57-65fa-4274-9625-3fd7f92ec0bf None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:05.558803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f4c57-65fa-4274-9625-3fd7f92ec0bf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:05.558803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f4c57-65fa-4274-9625-3fd7f92ec0bf None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:05.560142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 618/1261] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:59:05.565220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff6a2-f9dc-4339-a3c4-bf53a7eed037 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:05.565603 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff6a2-f9dc-4339-a3c4-bf53a7eed037 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:05.565768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff6a2-f9dc-4339-a3c4-bf53a7eed037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:05.584481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-922ff6a2-f9dc-4339-a3c4-bf53a7eed037 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:59:05.585651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-922ff6a2-f9dc-4339-a3c4-bf53a7eed037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:59:05.660977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 644/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:59:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:59:05.686526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f4c57-65fa-4274-9625-3fd7f92ec0bf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:05.697796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:05.791892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f4c57-65fa-4274-9625-3fd7f92ec0bf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:05.824249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37405e5-1715-49de-acb3-f21f851f95ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:05.824815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37405e5-1715-49de-acb3-f21f851f95ca None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:05.825088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37405e5-1715-49de-acb3-f21f851f95ca None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:05.825354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37405e5-1715-49de-acb3-f21f851f95ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:05.835520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37405e5-1715-49de-acb3-f21f851f95ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f37405e5-1715-49de-acb3-f21f851f95ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:59:05.840302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:05.841390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:59:05.842502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 619/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:59:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:05.847412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ff6a2-f9dc-4339-a3c4-bf53a7eed037 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:05.865549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:05.944930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ff6a2-f9dc-4339-a3c4-bf53a7eed037 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:05.976873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a95926-63bf-40f9-9e7e-6af199e67043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:05.977476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a95926-63bf-40f9-9e7e-6af199e67043 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:05.977754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a95926-63bf-40f9-9e7e-6af199e67043 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:05.978025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a95926-63bf-40f9-9e7e-6af199e67043 None admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:05.978766 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a95926-63bf-40f9-9e7e-6af199e67043 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:05.979067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a95926-63bf-40f9-9e7e-6af199e67043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:05.980434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a95926-63bf-40f9-9e7e-6af199e67043 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:05.988121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 645/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:59:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:05.994408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37405e5-1715-49de-acb3-f21f851f95ca None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:06.058368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:06.101245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37405e5-1715-49de-acb3-f21f851f95ca None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:06.134586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0befb-a6b6-4b2f-86aa-bef6319f60aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:06.135204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0befb-a6b6-4b2f-86aa-bef6319f60aa None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:06.135479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0befb-a6b6-4b2f-86aa-bef6319f60aa None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:06.135746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0befb-a6b6-4b2f-86aa-bef6319f60aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:06.145314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0befb-a6b6-4b2f-86aa-bef6319f60aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:06.146774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0befb-a6b6-4b2f-86aa-bef6319f60aa None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5ec0befb-a6b6-4b2f-86aa-bef6319f60aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:59:06.160973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:06.162029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:06.163153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:59:06.163153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:59:06.163153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:06.163153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:59:06.163153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 620/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:06.168088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a95926-63bf-40f9-9e7e-6af199e67043 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:06.246264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:06.265065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a95926-63bf-40f9-9e7e-6af199e67043 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:06.296652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12ba4d-5259-4496-a08a-56374f7beb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:06.297245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12ba4d-5259-4496-a08a-56374f7beb45 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:06.297517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12ba4d-5259-4496-a08a-56374f7beb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:06.297784 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12ba4d-5259-4496-a08a-56374f7beb45 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:06.298533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12ba4d-5259-4496-a08a-56374f7beb45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:06.298896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12ba4d-5259-4496-a08a-56374f7beb45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:06.300260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12ba4d-5259-4496-a08a-56374f7beb45 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:06.312067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 646/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:06.318401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0befb-a6b6-4b2f-86aa-bef6319f60aa None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:06.420986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0befb-a6b6-4b2f-86aa-bef6319f60aa None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:06.441241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:06.455542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8ca37-8e8e-4aee-ba89-cbde807408ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:06.456171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8ca37-8e8e-4aee-ba89-cbde807408ca None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:06.456447 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8ca37-8e8e-4aee-ba89-cbde807408ca None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:06.456742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8ca37-8e8e-4aee-ba89-cbde807408ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:06.463902 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8ca37-8e8e-4aee-ba89-cbde807408ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:06.465320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8ca37-8e8e-4aee-ba89-cbde807408ca None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-77f8ca37-8e8e-4aee-ba89-cbde807408ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:59:06.476689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:06.477759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:59:06.478782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 621/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:59:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:06.483655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12ba4d-5259-4496-a08a-56374f7beb45 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:06.578887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12ba4d-5259-4496-a08a-56374f7beb45 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:06.611384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbaa17-45a0-4899-9a5e-09d91052047c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:06.612103 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbaa17-45a0-4899-9a5e-09d91052047c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:06.612272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbaa17-45a0-4899-9a5e-09d91052047c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:06.612542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbaa17-45a0-4899-9a5e-09d91052047c None admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:06.613883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbaa17-45a0-4899-9a5e-09d91052047c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:06.614188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbaa17-45a0-4899-9a5e-09d91052047c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:06.615686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbaa17-45a0-4899-9a5e-09d91052047c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:06.624749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:06.635382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 647/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jul 28 01:59:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:06.642663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8ca37-8e8e-4aee-ba89-cbde807408ca None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:06.742257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8ca37-8e8e-4aee-ba89-cbde807408ca None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:06.774739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5b361-2ae4-40b1-b39f-0525c0460604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:06.775358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5b361-2ae4-40b1-b39f-0525c0460604 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:06.775635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5b361-2ae4-40b1-b39f-0525c0460604 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:06.775901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5b361-2ae4-40b1-b39f-0525c0460604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:06.786723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5b361-2ae4-40b1-b39f-0525c0460604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:06.788142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5b361-2ae4-40b1-b39f-0525c0460604 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e7a5b361-2ae4-40b1-b39f-0525c0460604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:59:06.801702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:06.802804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:06.803912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:59:06.803912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:59:06.803912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:06.803912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:59:06.803912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 622/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:59:06.810594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbaa17-45a0-4899-9a5e-09d91052047c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:06.910852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbaa17-45a0-4899-9a5e-09d91052047c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:06.943613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540bf97-3275-4954-be7f-418ea472c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:06.944217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540bf97-3275-4954-be7f-418ea472c855 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:06.944492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540bf97-3275-4954-be7f-418ea472c855 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:06.944760 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540bf97-3275-4954-be7f-418ea472c855 None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:06.945440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540bf97-3275-4954-be7f-418ea472c855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:06.945742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540bf97-3275-4954-be7f-418ea472c855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:06.947137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540bf97-3275-4954-be7f-418ea472c855 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:06.958270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 648/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:06.963872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5b361-2ae4-40b1-b39f-0525c0460604 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:06.995188 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:07.061992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5b361-2ae4-40b1-b39f-0525c0460604 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:07.094819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c98f1-482e-4293-b836-f5cc9f4a45a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:07.095439 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c98f1-482e-4293-b836-f5cc9f4a45a1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:07.095717 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c98f1-482e-4293-b836-f5cc9f4a45a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:07.095994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c98f1-482e-4293-b836-f5cc9f4a45a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:07.102428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c98f1-482e-4293-b836-f5cc9f4a45a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:07.103882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c98f1-482e-4293-b836-f5cc9f4a45a1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-160c98f1-482e-4293-b836-f5cc9f4a45a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:59:07.114850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:07.115865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:07.116839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:59:07.116839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:59:07.116839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:59:07.116839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:59:07.116839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:59:07.116839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:59:07.116839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:59:07.116839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:59:07.116839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 623/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:07.121589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540bf97-3275-4954-be7f-418ea472c855 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:07.178330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:07.219635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540bf97-3275-4954-be7f-418ea472c855 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:07.252362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee0823-d39a-40ac-adbf-1d5dd75995d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:07.252910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee0823-d39a-40ac-adbf-1d5dd75995d3 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:07.253192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee0823-d39a-40ac-adbf-1d5dd75995d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:07.253461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee0823-d39a-40ac-adbf-1d5dd75995d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:07.254254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee0823-d39a-40ac-adbf-1d5dd75995d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:07.254599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee0823-d39a-40ac-adbf-1d5dd75995d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:07.256020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee0823-d39a-40ac-adbf-1d5dd75995d3 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:07.268459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 649/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:59:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:07.274344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c98f1-482e-4293-b836-f5cc9f4a45a1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:07.362790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:07.372705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c98f1-482e-4293-b836-f5cc9f4a45a1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:07.404525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50abdf-f24a-405f-b1d5-1fef0753c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:07.405170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50abdf-f24a-405f-b1d5-1fef0753c756 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:07.405447 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50abdf-f24a-405f-b1d5-1fef0753c756 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:07.405715 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50abdf-f24a-405f-b1d5-1fef0753c756 None admin] PATH_INFO: `/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/e041d38c69cd4626898bc1412f5ed1d4/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:07.407664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50abdf-f24a-405f-b1d5-1fef0753c756 None admin] RBAC: Authorizing `identity:create_grant(project_id=03175c7be3f34efda54c3459e5ba94c8, user_id=e041d38c69cd4626898bc1412f5ed1d4, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:07.409090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50abdf-f24a-405f-b1d5-1fef0753c756 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:07.421755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 624/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Jul 28 01:59:07 2022] PUT /identity/v3/projects/03175c7be3f34efda54c3459e5ba94c8/users/e041d38c69cd4626898bc1412f5ed1d4/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 01:59:09.376322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba550d18-7925-4f1e-ac3d-546f7ce40de5 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:09.376855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba550d18-7925-4f1e-ac3d-546f7ce40de5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:09.376855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba550d18-7925-4f1e-ac3d-546f7ce40de5 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:09.378208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 650/1274] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:59:09.383719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba283b9-adb9-4516-8693-e8997e01d921 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:09.384083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba283b9-adb9-4516-8693-e8997e01d921 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:09.384265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba283b9-adb9-4516-8693-e8997e01d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:09.402392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-dba283b9-adb9-4516-8693-e8997e01d921 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:59:09.403683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dba283b9-adb9-4516-8693-e8997e01d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:59:09.467815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 625/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:59:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:59:09.490238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba550d18-7925-4f1e-ac3d-546f7ce40de5 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:09.587782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba550d18-7925-4f1e-ac3d-546f7ce40de5 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:09.604075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:09.621972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5266683-f9df-4a8b-b43d-c112e3492d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:09.622560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5266683-f9df-4a8b-b43d-c112e3492d52 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:09.622838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5266683-f9df-4a8b-b43d-c112e3492d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:09.623110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5266683-f9df-4a8b-b43d-c112e3492d52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:09.635487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5266683-f9df-4a8b-b43d-c112e3492d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-b5266683-f9df-4a8b-b43d-c112e3492d52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 01:59:09.640345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:09.641503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:09.642726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 651/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Jul 28 01:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:09.648263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba283b9-adb9-4516-8693-e8997e01d921 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:09.727269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:09.746120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba283b9-adb9-4516-8693-e8997e01d921 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:09.779170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1fe34-d11a-43a3-98da-92b4c00c4dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:09.779771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1fe34-d11a-43a3-98da-92b4c00c4dae None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:09.780055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1fe34-d11a-43a3-98da-92b4c00c4dae None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:09.780328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1fe34-d11a-43a3-98da-92b4c00c4dae None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:09.781038 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1fe34-d11a-43a3-98da-92b4c00c4dae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:09.781342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1fe34-d11a-43a3-98da-92b4c00c4dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:09.782718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1fe34-d11a-43a3-98da-92b4c00c4dae None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:09.790556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 626/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Jul 28 01:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:09.796072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5266683-f9df-4a8b-b43d-c112e3492d52 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:09.892417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5266683-f9df-4a8b-b43d-c112e3492d52 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:09.924759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1f64f-b2c0-479a-ae93-719678d8b186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:09.925380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1f64f-b2c0-479a-ae93-719678d8b186 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:09.926168 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1f64f-b2c0-479a-ae93-719678d8b186 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:09.926476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1f64f-b2c0-479a-ae93-719678d8b186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:09.936128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1f64f-b2c0-479a-ae93-719678d8b186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:09.937571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1f64f-b2c0-479a-ae93-719678d8b186 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-24e1f64f-b2c0-479a-ae93-719678d8b186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:59:09.952342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:09.953372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:09.954652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:59:09.954652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:59:09.954652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:09.954652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:09.954652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 652/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:09.959104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1fe34-d11a-43a3-98da-92b4c00c4dae None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:10.055605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1fe34-d11a-43a3-98da-92b4c00c4dae None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:10.088314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812ddf9-18e1-49a4-91e9-ca576f1bbe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:10.088913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812ddf9-18e1-49a4-91e9-ca576f1bbe0c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:10.089188 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812ddf9-18e1-49a4-91e9-ca576f1bbe0c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:10.089455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812ddf9-18e1-49a4-91e9-ca576f1bbe0c None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:10.090129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812ddf9-18e1-49a4-91e9-ca576f1bbe0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:10.090428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812ddf9-18e1-49a4-91e9-ca576f1bbe0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:10.091803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812ddf9-18e1-49a4-91e9-ca576f1bbe0c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:10.103488 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 627/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:10.108859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1f64f-b2c0-479a-ae93-719678d8b186 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:10.138673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:10.204884 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1f64f-b2c0-479a-ae93-719678d8b186 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:10.236999 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9d98d-4793-41b7-851a-9bb20f187118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:10.237617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9d98d-4793-41b7-851a-9bb20f187118 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:10.237890 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9d98d-4793-41b7-851a-9bb20f187118 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:10.238736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9d98d-4793-41b7-851a-9bb20f187118 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:10.245960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9d98d-4793-41b7-851a-9bb20f187118 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:10.247441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9d98d-4793-41b7-851a-9bb20f187118 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-95a9d98d-4793-41b7-851a-9bb20f187118 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 01:59:10.258478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:10.259599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:10.260783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 653/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:59:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:10.265487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812ddf9-18e1-49a4-91e9-ca576f1bbe0c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:10.269168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:10.361594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812ddf9-18e1-49a4-91e9-ca576f1bbe0c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:10.394445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cb04e-5cf5-4eef-8d60-e22448fd60c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:10.395069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb04e-5cf5-4eef-8d60-e22448fd60c5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:10.395346 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb04e-5cf5-4eef-8d60-e22448fd60c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:10.395615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb04e-5cf5-4eef-8d60-e22448fd60c5 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:10.396392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cb04e-5cf5-4eef-8d60-e22448fd60c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:10.396693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cb04e-5cf5-4eef-8d60-e22448fd60c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:10.398109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cb04e-5cf5-4eef-8d60-e22448fd60c5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:10.414963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 628/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Jul 28 01:59:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:10.420629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9d98d-4793-41b7-851a-9bb20f187118 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:10.511720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:10.522058 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9d98d-4793-41b7-851a-9bb20f187118 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:10.554309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5380-66b3-4ef4-bef9-918537660304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:10.554934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5380-66b3-4ef4-bef9-918537660304 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:10.555215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5380-66b3-4ef4-bef9-918537660304 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:10.555490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5380-66b3-4ef4-bef9-918537660304 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:10.622890 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf5380-66b3-4ef4-bef9-918537660304 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:10.624564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf5380-66b3-4ef4-bef9-918537660304 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:10.714069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:10.724524 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 654/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Jul 28 01:59:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 01:59:10.730369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cb04e-5cf5-4eef-8d60-e22448fd60c5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:10.798461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:10.837583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cb04e-5cf5-4eef-8d60-e22448fd60c5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:10.869788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01889f-8127-4250-a178-4f258bbfa78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:10.870412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01889f-8127-4250-a178-4f258bbfa78f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:10.870710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01889f-8127-4250-a178-4f258bbfa78f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:10.870980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01889f-8127-4250-a178-4f258bbfa78f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:10.881243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01889f-8127-4250-a178-4f258bbfa78f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:10.882693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01889f-8127-4250-a178-4f258bbfa78f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ba01889f-8127-4250-a178-4f258bbfa78f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 01:59:10.897340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:10.898417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:10.899385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 01:59:10.899385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 01:59:10.899385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 01:59:10.899385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:59:10.899385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 629/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 01:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:10.904128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5380-66b3-4ef4-bef9-918537660304 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:10.998896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5380-66b3-4ef4-bef9-918537660304 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:11.032207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665dbb-ec16-4b8f-9e48-fac1504afb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:11.032808 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665dbb-ec16-4b8f-9e48-fac1504afb1c None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:11.033093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665dbb-ec16-4b8f-9e48-fac1504afb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:11.033363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665dbb-ec16-4b8f-9e48-fac1504afb1c None admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:11.034055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5665dbb-ec16-4b8f-9e48-fac1504afb1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:11.034357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5665dbb-ec16-4b8f-9e48-fac1504afb1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:11.035767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5665dbb-ec16-4b8f-9e48-fac1504afb1c None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:11.046574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 655/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Jul 28 01:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:11.052022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01889f-8127-4250-a178-4f258bbfa78f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:11.155721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01889f-8127-4250-a178-4f258bbfa78f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:11.169113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:11.188855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7d849-49b6-4be3-95d3-45079c17e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:11.189473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7d849-49b6-4be3-95d3-45079c17e79e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:11.189746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7d849-49b6-4be3-95d3-45079c17e79e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:11.190009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7d849-49b6-4be3-95d3-45079c17e79e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:11.197233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7d849-49b6-4be3-95d3-45079c17e79e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:11.198684 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7d849-49b6-4be3-95d3-45079c17e79e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-26a7d849-49b6-4be3-95d3-45079c17e79e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 01:59:11.209533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:11.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:11.211733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 01:59:11.211733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 01:59:11.211733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 01:59:11.211733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 01:59:11.211733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 01:59:11.211733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 01:59:11.211733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 01:59:11.211733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 28 01:59:11.211733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 630/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Jul 28 01:59:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:11.216509 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665dbb-ec16-4b8f-9e48-fac1504afb1c None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:11.266056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:11.314306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665dbb-ec16-4b8f-9e48-fac1504afb1c None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:11.346722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bab28a-3b7f-4399-b254-e84b7027a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:11.347326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bab28a-3b7f-4399-b254-e84b7027a73b None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:11.347605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bab28a-3b7f-4399-b254-e84b7027a73b None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:11.347877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bab28a-3b7f-4399-b254-e84b7027a73b None admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:11.348622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bab28a-3b7f-4399-b254-e84b7027a73b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:11.348926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bab28a-3b7f-4399-b254-e84b7027a73b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:11.350352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bab28a-3b7f-4399-b254-e84b7027a73b None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:11.361786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 656/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Jul 28 01:59:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:11.368431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7d849-49b6-4be3-95d3-45079c17e79e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:11.464542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7d849-49b6-4be3-95d3-45079c17e79e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:11.497564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ea12e-b226-4cb8-9706-0a980c47ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:11.498173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ea12e-b226-4cb8-9706-0a980c47ad86 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:11.498594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ea12e-b226-4cb8-9706-0a980c47ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:11.498873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ea12e-b226-4cb8-9706-0a980c47ad86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:11.499707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ea12e-b226-4cb8-9706-0a980c47ad86 None admin] RBAC: Adding query filter params (role.id=2ea26ef62c144a6698a8e8f249e74409, scope.project.id=03175c7be3f34efda54c3459e5ba94c8, user.id=e041d38c69cd4626898bc1412f5ed1d4) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:11.500118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ea12e-b226-4cb8-9706-0a980c47ad86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:11.501631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ea12e-b226-4cb8-9706-0a980c47ad86 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:11.508045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 631/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Jul 28 01:59:11 2022] GET /identity/v3/role_assignments?user.id=e041d38c69cd4626898bc1412f5ed1d4&scope.project.id=03175c7be3f34efda54c3459e5ba94c8&role.id=2ea26ef62c144a6698a8e8f249e74409 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:13.500319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb8bcb-405d-4e49-b2fd-e439ca8107d0 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:13.500840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb8bcb-405d-4e49-b2fd-e439ca8107d0 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:13.500840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb8bcb-405d-4e49-b2fd-e439ca8107d0 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:13.502190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 657/1288] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:59:13.507332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1942d-1835-4a51-8467-cb8f7a795888 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:13.507698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1942d-1835-4a51-8467-cb8f7a795888 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:13.507874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1942d-1835-4a51-8467-cb8f7a795888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:13.525924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-eae1942d-1835-4a51-8467-cb8f7a795888 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:59:13.527175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-eae1942d-1835-4a51-8467-cb8f7a795888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:59:13.556040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:13.593046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 632/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:59:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:59:13.616976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb8bcb-405d-4e49-b2fd-e439ca8107d0 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:13.727959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb8bcb-405d-4e49-b2fd-e439ca8107d0 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:13.738083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:13.760722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1062c-8153-4be9-9913-9784be113082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:13.761283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1062c-8153-4be9-9913-9784be113082 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:13.761558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1062c-8153-4be9-9913-9784be113082 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:13.761827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1062c-8153-4be9-9913-9784be113082 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:13.762458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1062c-8153-4be9-9913-9784be113082 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:13.763828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1062c-8153-4be9-9913-9784be113082 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-13e1062c-8153-4be9-9913-9784be113082 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:13.775218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:13.776431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:13.777705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 658/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jul 28 01:59:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 01:59:13.782661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1942d-1835-4a51-8467-cb8f7a795888 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:13.880298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1942d-1835-4a51-8467-cb8f7a795888 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:13.913229 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a6c9d-5499-444c-b016-bd0394238cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:13.913831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a6c9d-5499-444c-b016-bd0394238cae None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:13.914106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a6c9d-5499-444c-b016-bd0394238cae None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:13.914383 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a6c9d-5499-444c-b016-bd0394238cae None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:13.915080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a6c9d-5499-444c-b016-bd0394238cae None admin] RBAC: Adding query filter params (name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:13.915382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a6c9d-5499-444c-b016-bd0394238cae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:13.916732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a6c9d-5499-444c-b016-bd0394238cae None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:13.921445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 633/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Jul 28 01:59:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:13.927193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1062c-8153-4be9-9913-9784be113082 None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:14.025573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1062c-8153-4be9-9913-9784be113082 None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:14.058928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11308-456a-47cf-af23-b8d2b7f1e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:14.059824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11308-456a-47cf-af23-b8d2b7f1e519 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:14.060287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11308-456a-47cf-af23-b8d2b7f1e519 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:14.060754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11308-456a-47cf-af23-b8d2b7f1e519 None admin] PATH_INFO: `/v3/services` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:14.061437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11308-456a-47cf-af23-b8d2b7f1e519 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:14.061744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11308-456a-47cf-af23-b8d2b7f1e519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:14.063151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11308-456a-47cf-af23-b8d2b7f1e519 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:14.075910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 659/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Jul 28 01:59:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:16.051162 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa97767-af67-4ba0-a161-0e104ed68660 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:16.051745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa97767-af67-4ba0-a161-0e104ed68660 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:16.051745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa97767-af67-4ba0-a161-0e104ed68660 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:16.053674 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 634/1293] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:59:16.058845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208d59-f61d-4dab-ad4f-69fa556b5dc4 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:16.059276 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208d59-f61d-4dab-ad4f-69fa556b5dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:16.059387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208d59-f61d-4dab-ad4f-69fa556b5dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:16.078011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-07208d59-f61d-4dab-ad4f-69fa556b5dc4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:59:16.079224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-07208d59-f61d-4dab-ad4f-69fa556b5dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:59:16.107922 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:16.144180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 660/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:59:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:59:16.166231 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa97767-af67-4ba0-a161-0e104ed68660 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:16.196839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:16.264789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa97767-af67-4ba0-a161-0e104ed68660 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:16.297467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcc686-fc60-46a9-bfd7-9cad25598c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:16.298060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcc686-fc60-46a9-bfd7-9cad25598c54 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:16.298334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcc686-fc60-46a9-bfd7-9cad25598c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:16.298635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcc686-fc60-46a9-bfd7-9cad25598c54 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:16.299319 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcc686-fc60-46a9-bfd7-9cad25598c54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:16.300657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcc686-fc60-46a9-bfd7-9cad25598c54 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:16.315131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 635/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Jul 28 01:59:16 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:59:18.295242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583fccf-cf50-4966-a3f2-193000d01691 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:18.295736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583fccf-cf50-4966-a3f2-193000d01691 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:18.295736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583fccf-cf50-4966-a3f2-193000d01691 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:18.297054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 661/1296] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:59:18.302227 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f8f6-1478-4d42-8c0b-064eef06529f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:18.302682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f8f6-1478-4d42-8c0b-064eef06529f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:18.302813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f8f6-1478-4d42-8c0b-064eef06529f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:18.321161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8a39f8f6-1478-4d42-8c0b-064eef06529f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:59:18.322348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8a39f8f6-1478-4d42-8c0b-064eef06529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:59:18.393415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 636/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:59:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:59:18.415766 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583fccf-cf50-4966-a3f2-193000d01691 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:18.517110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583fccf-cf50-4966-a3f2-193000d01691 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:18.550395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbd1ef-5711-45e6-b805-32de3668afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:18.551017 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd1ef-5711-45e6-b805-32de3668afad None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:18.551296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd1ef-5711-45e6-b805-32de3668afad None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:18.551566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd1ef-5711-45e6-b805-32de3668afad None admin] PATH_INFO: `/v3/services/placement` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:18.552193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbd1ef-5711-45e6-b805-32de3668afad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:18.553556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbd1ef-5711-45e6-b805-32de3668afad None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-2bfbd1ef-5711-45e6-b805-32de3668afad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:18.562351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:18.563704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:18.564942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 662/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jul 28 01:59:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:18.570350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39f8f6-1478-4d42-8c0b-064eef06529f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:18.588718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:18.684306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39f8f6-1478-4d42-8c0b-064eef06529f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:18.719395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27040c28-a14d-4909-b7b6-358abdf885c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:18.720008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27040c28-a14d-4909-b7b6-358abdf885c0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:18.720289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27040c28-a14d-4909-b7b6-358abdf885c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:18.720563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27040c28-a14d-4909-b7b6-358abdf885c0 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:18.721243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27040c28-a14d-4909-b7b6-358abdf885c0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:18.721546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27040c28-a14d-4909-b7b6-358abdf885c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:18.722980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27040c28-a14d-4909-b7b6-358abdf885c0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:18.728244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 637/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Jul 28 01:59:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:18.734062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbd1ef-5711-45e6-b805-32de3668afad None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:18.766125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:18.839908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbd1ef-5711-45e6-b805-32de3668afad None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:18.872257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef61d6-f1c0-4d5c-837e-42d302ec8792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:18.872861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef61d6-f1c0-4d5c-837e-42d302ec8792 None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:18.873139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef61d6-f1c0-4d5c-837e-42d302ec8792 None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:18.873410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef61d6-f1c0-4d5c-837e-42d302ec8792 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:18.874161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef61d6-f1c0-4d5c-837e-42d302ec8792 None admin] RBAC: Adding query filter params (interface=public, service_id=1884a449e0ac42349867be231dac19b5, region_id=RegionOne) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:18.874488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef61d6-f1c0-4d5c-837e-42d302ec8792 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:18.875853 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef61d6-f1c0-4d5c-837e-42d302ec8792 None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:18.881448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 663/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Jul 28 01:59:18 2022] GET /identity/v3/endpoints?service_id=1884a449e0ac42349867be231dac19b5&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:18.887094 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27040c28-a14d-4909-b7b6-358abdf885c0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:18.966298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:18.984664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27040c28-a14d-4909-b7b6-358abdf885c0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:19.018145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044391c-76f3-4140-805d-ffd76078f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:19.018779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044391c-76f3-4140-805d-ffd76078f96a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:19.019058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044391c-76f3-4140-805d-ffd76078f96a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:19.019331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044391c-76f3-4140-805d-ffd76078f96a None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:19.019974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044391c-76f3-4140-805d-ffd76078f96a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:19.021333 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044391c-76f3-4140-805d-ffd76078f96a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:19.028042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 638/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Jul 28 01:59:18 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 01:59:20.983130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b548-0c67-4551-919d-7516531b18e1 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:20.983654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b548-0c67-4551-919d-7516531b18e1 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:20.983654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b548-0c67-4551-919d-7516531b18e1 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:20.985008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 664/1302] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 01:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 01:59:20.990150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19901c-4e13-4934-a35a-d6119fad7167 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:20.990577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19901c-4e13-4934-a35a-d6119fad7167 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:20.990749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19901c-4e13-4934-a35a-d6119fad7167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:21.008293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7e19901c-4e13-4934-a35a-d6119fad7167 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 01:59:21.009477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7e19901c-4e13-4934-a35a-d6119fad7167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 01:59:21.073954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 639/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 01:59:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 01:59:21.096861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b548-0c67-4551-919d-7516531b18e1 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:21.190712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:21.198283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b548-0c67-4551-919d-7516531b18e1 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:21.232026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fb621-d071-4449-bc04-b125eadf79bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:21.232650 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fb621-d071-4449-bc04-b125eadf79bd None admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:21.232930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fb621-d071-4449-bc04-b125eadf79bd None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:21.233203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fb621-d071-4449-bc04-b125eadf79bd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:21.233831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fb621-d071-4449-bc04-b125eadf79bd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:21.235222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fb621-d071-4449-bc04-b125eadf79bd None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application [None req-c44fb621-d071-4449-bc04-b125eadf79bd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 01:59:21.243974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 01:59:21.245130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application with Lock( Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self._enter() Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application return self.creator() Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application created_value = creator( Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: ERROR keystone.server.flask.application Jul 28 01:59:21.245972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 665/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Jul 28 01:59:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 01:59:21.251223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19901c-4e13-4934-a35a-d6119fad7167 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:21.324862 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:21.347150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19901c-4e13-4934-a35a-d6119fad7167 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:21.379578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0ac88-cbb6-4616-817c-94747e94548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:21.380211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0ac88-cbb6-4616-817c-94747e94548d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:21.380496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0ac88-cbb6-4616-817c-94747e94548d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:21.380762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0ac88-cbb6-4616-817c-94747e94548d None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:21.381435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0ac88-cbb6-4616-817c-94747e94548d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 01:59:21.381731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0ac88-cbb6-4616-817c-94747e94548d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:21.383124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0ac88-cbb6-4616-817c-94747e94548d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:21.388241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 640/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Jul 28 01:59:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 01:59:21.394124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fb621-d071-4449-bc04-b125eadf79bd None admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 01:59:21.491931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fb621-d071-4449-bc04-b125eadf79bd None admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 01:59:21.525054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a6e86-2c4c-4d4c-ba34-6eaf6da95f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 01:59:21.525657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6e86-2c4c-4d4c-ba34-6eaf6da95f3d None admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 01:59:21.525936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6e86-2c4c-4d4c-ba34-6eaf6da95f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 01:59:21.526209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6e86-2c4c-4d4c-ba34-6eaf6da95f3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 01:59:21.526952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a6e86-2c4c-4d4c-ba34-6eaf6da95f3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 01:59:21.528315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a6e86-2c4c-4d4c-ba34-6eaf6da95f3d None admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 01:59:21.547166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 666/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 01:59:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 01:59:31.385230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=30 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:59:31.543333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:24.060168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7ef38-4510-40fa-87ad-9338033e5df6 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:24.061064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7ef38-4510-40fa-87ad-9338033e5df6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:24.061502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7ef38-4510-40fa-87ad-9338033e5df6 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:24.063212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 641/1307] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:24.068588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06991a0f-3884-4eba-a911-a5d15279f06b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:24.069019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06991a0f-3884-4eba-a911-a5d15279f06b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:24.069339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06991a0f-3884-4eba-a911-a5d15279f06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:24.217221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-06991a0f-3884-4eba-a911-a5d15279f06b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:24.218520 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-06991a0f-3884-4eba-a911-a5d15279f06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:24.343245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 667/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:24.412369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d35d26-e2e8-4107-81c8-64ad135922df None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:24.412659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d35d26-e2e8-4107-81c8-64ad135922df None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:24.412938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d35d26-e2e8-4107-81c8-64ad135922df None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:24.414462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 642/1309] 10.222.0.36 () {54 vars in 965 bytes} [Thu Jul 28 02:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:24.421818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c10988-2a43-4b88-8407-642250b672af None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:24.422124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c10988-2a43-4b88-8407-642250b672af None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:24.422373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c10988-2a43-4b88-8407-642250b672af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:24.611161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-07c10988-2a43-4b88-8407-642250b672af None None] MFA Rules not processed for user `50bf5763fbf94aa9b438a1be6ce88c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:24.614915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-07c10988-2a43-4b88-8407-642250b672af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:24.653046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:24.731353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 668/1310] 10.222.0.36 () {58 vars in 1062 bytes} [Thu Jul 28 02:00:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:24.741105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d35d26-e2e8-4107-81c8-64ad135922df None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:24.742891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-11d35d26-e2e8-4107-81c8-64ad135922df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:24.884950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d35d26-e2e8-4107-81c8-64ad135922df None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:24.973911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb7e33-fe0b-4526-8324-f97382be34dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:24.974579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7e33-fe0b-4526-8324-f97382be34dc service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:24.974860 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7e33-fe0b-4526-8324-f97382be34dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:24.975130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7e33-fe0b-4526-8324-f97382be34dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:24.976755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8acb7e33-fe0b-4526-8324-f97382be34dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:25.035367 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:25.096248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb7e33-fe0b-4526-8324-f97382be34dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:25.097695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb7e33-fe0b-4526-8324-f97382be34dc service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:25.118499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 643/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:27.478382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33121f-8ab8-4b29-b87f-f23b5da39c45 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:27.478925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33121f-8ab8-4b29-b87f-f23b5da39c45 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:27.478925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33121f-8ab8-4b29-b87f-f23b5da39c45 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:27.480245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 669/1312] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:27.485460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad4cd3-718d-4bac-bdeb-74be2311d815 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:27.485889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad4cd3-718d-4bac-bdeb-74be2311d815 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:27.486019 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad4cd3-718d-4bac-bdeb-74be2311d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:27.575443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-47ad4cd3-718d-4bac-bdeb-74be2311d815 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:27.576648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-47ad4cd3-718d-4bac-bdeb-74be2311d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:27.684781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 644/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:27.736626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13403a05-f3dd-4d32-9b9a-a806a9093c6a None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:27.736850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13403a05-f3dd-4d32-9b9a-a806a9093c6a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:27.737087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13403a05-f3dd-4d32-9b9a-a806a9093c6a None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:27.738529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 670/1314] 10.222.0.36 () {54 vars in 965 bytes} [Thu Jul 28 02:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:27.744741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8bd96-4e00-4f83-8b6e-783a16a62e44 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:27.745023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8bd96-4e00-4f83-8b6e-783a16a62e44 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:27.745297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8bd96-4e00-4f83-8b6e-783a16a62e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:27.757146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:27.821026 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b1e8bd96-4e00-4f83-8b6e-783a16a62e44 None None] MFA Rules not processed for user `50bf5763fbf94aa9b438a1be6ce88c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:27.822226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b1e8bd96-4e00-4f83-8b6e-783a16a62e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:27.907502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 645/1315] 10.222.0.36 () {58 vars in 1062 bytes} [Thu Jul 28 02:00:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:27.917639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13403a05-f3dd-4d32-9b9a-a806a9093c6a None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:27.919241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-13403a05-f3dd-4d32-9b9a-a806a9093c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:28.030134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13403a05-f3dd-4d32-9b9a-a806a9093c6a None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:28.101296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:28.103943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680b49f-f17c-4581-8c2e-2d0e006cfcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:28.104780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680b49f-f17c-4581-8c2e-2d0e006cfcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:28.105234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680b49f-f17c-4581-8c2e-2d0e006cfcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:28.105553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680b49f-f17c-4581-8c2e-2d0e006cfcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:28.107372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a680b49f-f17c-4581-8c2e-2d0e006cfcf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:28.213551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680b49f-f17c-4581-8c2e-2d0e006cfcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:28.215008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680b49f-f17c-4581-8c2e-2d0e006cfcf0 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:28.233069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 671/1316] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:30.731953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3ddb-4cc9-499f-8612-bbe6f5998bf3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:30.732487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3ddb-4cc9-499f-8612-bbe6f5998bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:30.732487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3ddb-4cc9-499f-8612-bbe6f5998bf3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:30.733847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 646/1317] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:30.739359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beb227-1a1e-4142-bfc3-fdc82ea7238b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:30.739786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beb227-1a1e-4142-bfc3-fdc82ea7238b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:30.739911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beb227-1a1e-4142-bfc3-fdc82ea7238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:30.805016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e7beb227-1a1e-4142-bfc3-fdc82ea7238b None None] MFA Rules not processed for user `1921ee40ca9a4f31b2382206170afd2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:30.806200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e7beb227-1a1e-4142-bfc3-fdc82ea7238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:30.861405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:30.907121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 672/1318] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:30.947375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd3ddb-4cc9-499f-8612-bbe6f5998bf3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:30.948905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-14cd3ddb-4cc9-499f-8612-bbe6f5998bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:31.049214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd3ddb-4cc9-499f-8612-bbe6f5998bf3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:31.052653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:31.122027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d587d-517c-4d05-8696-b101cb10dc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:31.122657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d587d-517c-4d05-8696-b101cb10dc6b service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:31.122934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d587d-517c-4d05-8696-b101cb10dc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:31.123202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d587d-517c-4d05-8696-b101cb10dc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:31.124782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fa1d587d-517c-4d05-8696-b101cb10dc6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:31.236034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d587d-517c-4d05-8696-b101cb10dc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:31.238150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d587d-517c-4d05-8696-b101cb10dc6b service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:31.259707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 647/1319] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:33.803274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f9430-5255-4774-b25a-c3e01a015483 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:33.803804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f9430-5255-4774-b25a-c3e01a015483 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:33.803804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f9430-5255-4774-b25a-c3e01a015483 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:33.805180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 673/1320] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:33.810479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8646-2715-4c2d-aa95-2adeac7a6082 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:33.810876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8646-2715-4c2d-aa95-2adeac7a6082 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:33.811042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8646-2715-4c2d-aa95-2adeac7a6082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:33.852170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:33.878578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4bdf8646-2715-4c2d-aa95-2adeac7a6082 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:33.879796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4bdf8646-2715-4c2d-aa95-2adeac7a6082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:33.972235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 648/1321] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:34.011028 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f9430-5255-4774-b25a-c3e01a015483 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:34.012552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ff4f9430-5255-4774-b25a-c3e01a015483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:34.113842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f9430-5255-4774-b25a-c3e01a015483 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:34.184938 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b33c3b-e3a0-4e92-82d6-97be32b08b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:34.185573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33c3b-e3a0-4e92-82d6-97be32b08b22 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:34.185854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33c3b-e3a0-4e92-82d6-97be32b08b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:34.186128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33c3b-e3a0-4e92-82d6-97be32b08b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:34.187755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e3b33c3b-e3a0-4e92-82d6-97be32b08b22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:34.195255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:34.295232 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b33c3b-e3a0-4e92-82d6-97be32b08b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:34.296664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b33c3b-e3a0-4e92-82d6-97be32b08b22 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:34.314827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 674/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:36.961144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96311d9c-da75-4ff6-bd00-92b8889fc89f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:36.961695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96311d9c-da75-4ff6-bd00-92b8889fc89f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:36.961695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96311d9c-da75-4ff6-bd00-92b8889fc89f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:36.963083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 649/1323] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:36.968086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7058-b861-4e11-ba21-0f383fe6f4ec None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:36.968519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7058-b861-4e11-ba21-0f383fe6f4ec None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:36.968621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7058-b861-4e11-ba21-0f383fe6f4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:37.035293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d2ff7058-b861-4e11-ba21-0f383fe6f4ec None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:37.036478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d2ff7058-b861-4e11-ba21-0f383fe6f4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:37.095245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:37.138082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 675/1324] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:37.175370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96311d9c-da75-4ff6-bd00-92b8889fc89f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:37.176975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-96311d9c-da75-4ff6-bd00-92b8889fc89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:37.291998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96311d9c-da75-4ff6-bd00-92b8889fc89f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:37.308962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:37.379337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78242c-e197-4d9a-9478-cf16c3e1a263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:37.379954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78242c-e197-4d9a-9478-cf16c3e1a263 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:37.380235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78242c-e197-4d9a-9478-cf16c3e1a263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:37.380507 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78242c-e197-4d9a-9478-cf16c3e1a263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:37.382128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3f78242c-e197-4d9a-9478-cf16c3e1a263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:37.490728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78242c-e197-4d9a-9478-cf16c3e1a263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:37.492086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78242c-e197-4d9a-9478-cf16c3e1a263 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:37.509876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 650/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:39.585280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5251892-b22b-4d3c-829e-1e3d417563d7 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:39.585827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5251892-b22b-4d3c-829e-1e3d417563d7 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:39.585924 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5251892-b22b-4d3c-829e-1e3d417563d7 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:39.587242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 676/1326] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:39.592531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcfa2-2a09-4892-acbd-cef5a578a207 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:39.592917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcfa2-2a09-4892-acbd-cef5a578a207 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:39.593090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcfa2-2a09-4892-acbd-cef5a578a207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:39.647721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:39.666637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9e8bcfa2-2a09-4892-acbd-cef5a578a207 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:39.667971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9e8bcfa2-2a09-4892-acbd-cef5a578a207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:39.764726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 651/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:39.801673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5251892-b22b-4d3c-829e-1e3d417563d7 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:39.803238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e5251892-b22b-4d3c-829e-1e3d417563d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:39.911273 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5251892-b22b-4d3c-829e-1e3d417563d7 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:39.986824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739357b-d833-421d-8155-09fc4c64c93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:39.987440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739357b-d833-421d-8155-09fc4c64c93e service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:39.987721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739357b-d833-421d-8155-09fc4c64c93e service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:39.987995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739357b-d833-421d-8155-09fc4c64c93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:39.990131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a739357b-d833-421d-8155-09fc4c64c93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:40.007555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:40.104606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739357b-d833-421d-8155-09fc4c64c93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:40.106118 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739357b-d833-421d-8155-09fc4c64c93e service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:40.123796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 677/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:42.192731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72b23f-a862-4dbd-94a8-33e227b524b3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:42.193265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72b23f-a862-4dbd-94a8-33e227b524b3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:42.193265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72b23f-a862-4dbd-94a8-33e227b524b3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:42.194597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 652/1329] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:42.199798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d55f01-8f78-422e-9f65-d71560206289 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:42.200223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d55f01-8f78-422e-9f65-d71560206289 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:42.200362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d55f01-8f78-422e-9f65-d71560206289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:42.271620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-50d55f01-8f78-422e-9f65-d71560206289 None None] MFA Rules not processed for user `1921ee40ca9a4f31b2382206170afd2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:42.272810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-50d55f01-8f78-422e-9f65-d71560206289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:42.338096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:42.373223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 678/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:42.411282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72b23f-a862-4dbd-94a8-33e227b524b3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:42.412851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7d72b23f-a862-4dbd-94a8-33e227b524b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:42.519012 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72b23f-a862-4dbd-94a8-33e227b524b3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:42.540616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:42.594813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b702f10-6566-478c-a126-6de549836ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:42.595551 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b702f10-6566-478c-a126-6de549836ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:42.595828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b702f10-6566-478c-a126-6de549836ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:42.596108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b702f10-6566-478c-a126-6de549836ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:42.598349 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3b702f10-6566-478c-a126-6de549836ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:42.710097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b702f10-6566-478c-a126-6de549836ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:42.711582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b702f10-6566-478c-a126-6de549836ea7 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:42.730061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 653/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:44.994773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379830b-edfe-495d-8719-bbdff3c15193 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:44.995300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379830b-edfe-495d-8719-bbdff3c15193 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:44.995300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379830b-edfe-495d-8719-bbdff3c15193 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:44.996623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 679/1332] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:45.001852 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1f30d-5f25-4c9c-b156-d40334a59c93 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:45.002264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1f30d-5f25-4c9c-b156-d40334a59c93 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:45.002432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1f30d-5f25-4c9c-b156-d40334a59c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:45.065558 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:45.068842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-36b1f30d-5f25-4c9c-b156-d40334a59c93 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:45.070579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-36b1f30d-5f25-4c9c-b156-d40334a59c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:45.167573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 654/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:45.203269 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379830b-edfe-495d-8719-bbdff3c15193 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:45.204771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c379830b-edfe-495d-8719-bbdff3c15193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:45.306519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379830b-edfe-495d-8719-bbdff3c15193 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:45.381396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3bd0d-7cf2-45bb-8dbe-bb0262a2ebcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:45.382006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3bd0d-7cf2-45bb-8dbe-bb0262a2ebcd service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:45.382286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3bd0d-7cf2-45bb-8dbe-bb0262a2ebcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:45.382594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3bd0d-7cf2-45bb-8dbe-bb0262a2ebcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:45.384202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-70a3bd0d-7cf2-45bb-8dbe-bb0262a2ebcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:45.410482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:45.491626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3bd0d-7cf2-45bb-8dbe-bb0262a2ebcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:45.493061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3bd0d-7cf2-45bb-8dbe-bb0262a2ebcd service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:45.510978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 680/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:47.544766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a1556-4a91-4258-aac9-46e3e4791f42 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:47.545302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a1556-4a91-4258-aac9-46e3e4791f42 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:47.545302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a1556-4a91-4258-aac9-46e3e4791f42 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:47.546739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 655/1335] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:47.551891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b2e39-0f83-4b7f-9ef8-b0fe8fa93998 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:47.552292 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b2e39-0f83-4b7f-9ef8-b0fe8fa93998 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:47.552442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b2e39-0f83-4b7f-9ef8-b0fe8fa93998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:47.617216 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-bf2b2e39-0f83-4b7f-9ef8-b0fe8fa93998 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:47.618413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-bf2b2e39-0f83-4b7f-9ef8-b0fe8fa93998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:47.695094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:47.718971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 681/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:47.758923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a1556-4a91-4258-aac9-46e3e4791f42 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:47.760491 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2d1a1556-4a91-4258-aac9-46e3e4791f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:47.863154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a1556-4a91-4258-aac9-46e3e4791f42 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:47.891959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:47.937381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bce9a-ec01-4fee-8f5a-840546f59ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:47.937995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bce9a-ec01-4fee-8f5a-840546f59ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:47.938275 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bce9a-ec01-4fee-8f5a-840546f59ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:47.938582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bce9a-ec01-4fee-8f5a-840546f59ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:47.940812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2d5bce9a-ec01-4fee-8f5a-840546f59ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:48.051694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bce9a-ec01-4fee-8f5a-840546f59ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:48.053124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bce9a-ec01-4fee-8f5a-840546f59ba8 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:48.072487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 656/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:50.391777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f6f14-201c-4565-ab16-ece1e243baf6 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:50.392319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f6f14-201c-4565-ab16-ece1e243baf6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:50.392319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f6f14-201c-4565-ab16-ece1e243baf6 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:50.394181 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 682/1338] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:50.399261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c767-1ed2-4f84-b0dc-ad193b79d1fb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:50.399651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c767-1ed2-4f84-b0dc-ad193b79d1fb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:50.399803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c767-1ed2-4f84-b0dc-ad193b79d1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:50.464519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e121c767-1ed2-4f84-b0dc-ad193b79d1fb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:50.465705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e121c767-1ed2-4f84-b0dc-ad193b79d1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:50.474414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:50.562833 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 657/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:50.599252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f6f14-201c-4565-ab16-ece1e243baf6 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:50.600761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f94f6f14-201c-4565-ab16-ece1e243baf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:50.703715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f6f14-201c-4565-ab16-ece1e243baf6 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:50.775552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62153478-2e23-478a-a19a-2f7670840608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:50.776159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62153478-2e23-478a-a19a-2f7670840608 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:50.776436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62153478-2e23-478a-a19a-2f7670840608 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:50.776705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62153478-2e23-478a-a19a-2f7670840608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:50.778315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-62153478-2e23-478a-a19a-2f7670840608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:50.812443 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:50.885074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62153478-2e23-478a-a19a-2f7670840608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:50.886575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62153478-2e23-478a-a19a-2f7670840608 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:50.905148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 683/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:54.828791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783b8ca-d2aa-45f6-ae16-c083a8d122e6 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:54.829341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783b8ca-d2aa-45f6-ae16-c083a8d122e6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:54.829341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783b8ca-d2aa-45f6-ae16-c083a8d122e6 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:54.830771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 658/1341] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:54.836123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167103e0-64b2-4cdf-b145-b96a27af9868 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:54.836535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167103e0-64b2-4cdf-b145-b96a27af9868 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:54.836670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167103e0-64b2-4cdf-b145-b96a27af9868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:54.906277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-167103e0-64b2-4cdf-b145-b96a27af9868 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:54.907515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-167103e0-64b2-4cdf-b145-b96a27af9868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:54.992183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:55.004406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 684/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:55.043077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783b8ca-d2aa-45f6-ae16-c083a8d122e6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:55.044591 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e783b8ca-d2aa-45f6-ae16-c083a8d122e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:55.147858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783b8ca-d2aa-45f6-ae16-c083a8d122e6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:55.185970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:55.223316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c99993-d29c-4b72-ae21-77416f7d9f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:55.224047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c99993-d29c-4b72-ae21-77416f7d9f74 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:55.224328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c99993-d29c-4b72-ae21-77416f7d9f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:55.224593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c99993-d29c-4b72-ae21-77416f7d9f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:55.226226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-25c99993-d29c-4b72-ae21-77416f7d9f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:55.334462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c99993-d29c-4b72-ae21-77416f7d9f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:55.335929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c99993-d29c-4b72-ae21-77416f7d9f74 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:55.354300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 659/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:00:58.008525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2bdb1-fc62-4987-9ee2-2603025626be None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:58.009064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2bdb1-fc62-4987-9ee2-2603025626be None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:58.009064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2bdb1-fc62-4987-9ee2-2603025626be None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:58.010496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 685/1344] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:00:58.016397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69200f85-2113-495e-bee9-24e1881af2af None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:58.016922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69200f85-2113-495e-bee9-24e1881af2af None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:58.017090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69200f85-2113-495e-bee9-24e1881af2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:58.090844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-69200f85-2113-495e-bee9-24e1881af2af None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:00:58.092171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-69200f85-2113-495e-bee9-24e1881af2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:58.112932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:58.197856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 660/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:00:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:00:58.235373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2bdb1-fc62-4987-9ee2-2603025626be None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:00:58.237553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-16d2bdb1-fc62-4987-9ee2-2603025626be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:58.341033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2bdb1-fc62-4987-9ee2-2603025626be None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:00:58.418087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab50c34-52e5-40de-9e30-7414b38681bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:00:58.418635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50c34-52e5-40de-9e30-7414b38681bd service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:00:58.418916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50c34-52e5-40de-9e30-7414b38681bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:00:58.419190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50c34-52e5-40de-9e30-7414b38681bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:00:58.420820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fab50c34-52e5-40de-9e30-7414b38681bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:00:58.464202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:00:58.529687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab50c34-52e5-40de-9e30-7414b38681bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:00:58.531151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab50c34-52e5-40de-9e30-7414b38681bd service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:00:58.550301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 686/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:00:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:02.529723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa194a2-d2ee-4409-814d-3d8683a54be5 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:02.530256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa194a2-d2ee-4409-814d-3d8683a54be5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:02.530256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa194a2-d2ee-4409-814d-3d8683a54be5 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:02.531798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 661/1347] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:02.537571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a099f9-96bd-4a66-9593-7f2276c63bc5 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:02.538031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a099f9-96bd-4a66-9593-7f2276c63bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:02.538125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a099f9-96bd-4a66-9593-7f2276c63bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:02.604138 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-76a099f9-96bd-4a66-9593-7f2276c63bc5 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:02.605358 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-76a099f9-96bd-4a66-9593-7f2276c63bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:02.719738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:02.723258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 687/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:02.761184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa194a2-d2ee-4409-814d-3d8683a54be5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:02.762812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5aa194a2-d2ee-4409-814d-3d8683a54be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:02.875251 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa194a2-d2ee-4409-814d-3d8683a54be5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:02.925407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:02.952838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d43b4-3bd0-435c-9cd3-4bc9282dbcbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:02.953461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d43b4-3bd0-435c-9cd3-4bc9282dbcbd service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:02.953736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d43b4-3bd0-435c-9cd3-4bc9282dbcbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:02.954039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d43b4-3bd0-435c-9cd3-4bc9282dbcbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:02.956245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-950d43b4-3bd0-435c-9cd3-4bc9282dbcbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:03.068307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d43b4-3bd0-435c-9cd3-4bc9282dbcbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:03.069748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d43b4-3bd0-435c-9cd3-4bc9282dbcbd service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:03.089181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 662/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:08.045744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640b41-6c7f-4816-9763-194211c48811 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:08.046237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640b41-6c7f-4816-9763-194211c48811 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:08.046237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640b41-6c7f-4816-9763-194211c48811 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:08.047994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 688/1350] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:08.053117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0b71-0735-4580-9c3a-49cc3259cd12 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:08.053548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0b71-0735-4580-9c3a-49cc3259cd12 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:08.053665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0b71-0735-4580-9c3a-49cc3259cd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:08.145223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c4fc0b71-0735-4580-9c3a-49cc3259cd12 None None] MFA Rules not processed for user `e041d38c69cd4626898bc1412f5ed1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:08.146642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c4fc0b71-0735-4580-9c3a-49cc3259cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:08.165874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:08.278552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 663/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:01:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:12.253224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f886a-c5ac-4634-8f9b-803f13243d4a None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:12.253726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f886a-c5ac-4634-8f9b-803f13243d4a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:12.253726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f886a-c5ac-4634-8f9b-803f13243d4a None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:12.255262 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 689/1352] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:12.260047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cac9d-e1b1-4a9d-9507-f97f5758b042 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:12.260525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cac9d-e1b1-4a9d-9507-f97f5758b042 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:12.260803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cac9d-e1b1-4a9d-9507-f97f5758b042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:12.338648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f24cac9d-e1b1-4a9d-9507-f97f5758b042 None None] MFA Rules not processed for user `e041d38c69cd4626898bc1412f5ed1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:12.339866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f24cac9d-e1b1-4a9d-9507-f97f5758b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:12.417479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:12.456089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 664/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:13.886026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510d702-3fab-427b-85a9-8fcc9225d0d4 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:13.886512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510d702-3fab-427b-85a9-8fcc9225d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:13.886632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510d702-3fab-427b-85a9-8fcc9225d0d4 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:13.887984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 690/1354] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:13.893558 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d616d-0d10-43ce-8488-7a5c6ba9908a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:13.893981 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d616d-0d10-43ce-8488-7a5c6ba9908a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:13.894092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d616d-0d10-43ce-8488-7a5c6ba9908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:13.971787 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d85d616d-0d10-43ce-8488-7a5c6ba9908a None None] MFA Rules not processed for user `e041d38c69cd4626898bc1412f5ed1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:13.972999 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d85d616d-0d10-43ce-8488-7a5c6ba9908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:14.082863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 665/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:01:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:01:17.542751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa960-7875-4bcf-a059-3a8b299eeca7 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:17.543311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa960-7875-4bcf-a059-3a8b299eeca7 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:17.543423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa960-7875-4bcf-a059-3a8b299eeca7 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:17.544751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 691/1356] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 02:01:17.551224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006a118-ab69-4187-8764-7d58c62f2858 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:17.551716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006a118-ab69-4187-8764-7d58c62f2858 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:17.551980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006a118-ab69-4187-8764-7d58c62f2858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:17.607916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:17.655187 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7006a118-ab69-4187-8764-7d58c62f2858 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:17.656825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7006a118-ab69-4187-8764-7d58c62f2858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:17.762246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 666/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:17.818121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095c50b-f032-4cb2-9220-58d9b311219e None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:17.818719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095c50b-f032-4cb2-9220-58d9b311219e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:17.819303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095c50b-f032-4cb2-9220-58d9b311219e None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:17.820842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 692/1358] 10.222.0.36 () {54 vars in 962 bytes} [Thu Jul 28 02:01:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:17.831749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de223b-12d5-467c-9e6d-9e07c0144882 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:17.832549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de223b-12d5-467c-9e6d-9e07c0144882 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:17.833031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de223b-12d5-467c-9e6d-9e07c0144882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:17.916675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a1de223b-12d5-467c-9e6d-9e07c0144882 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:17.917872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a1de223b-12d5-467c-9e6d-9e07c0144882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:17.968691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:18.045683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 667/1359] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Jul 28 02:01:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:18.054047 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095c50b-f032-4cb2-9220-58d9b311219e None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:18.055598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a095c50b-f032-4cb2-9220-58d9b311219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:18.209130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095c50b-f032-4cb2-9220-58d9b311219e None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:18.284141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:18.335305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618ddb4-d52b-4e09-bbb7-36baa79d1c5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:18.335918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ddb4-d52b-4e09-bbb7-36baa79d1c5b service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:18.336203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ddb4-d52b-4e09-bbb7-36baa79d1c5b service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:18.336463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ddb4-d52b-4e09-bbb7-36baa79d1c5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:18.338056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b618ddb4-d52b-4e09-bbb7-36baa79d1c5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:18.443264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618ddb4-d52b-4e09-bbb7-36baa79d1c5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:18.444857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618ddb4-d52b-4e09-bbb7-36baa79d1c5b service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:18.463335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 693/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:20.678606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd744e7-9bd0-4f73-9604-767765368170 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:20.679343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd744e7-9bd0-4f73-9604-767765368170 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:20.679343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd744e7-9bd0-4f73-9604-767765368170 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:20.685594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c84889-1054-4f4b-881c-5ada3ea79751 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:20.686751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c84889-1054-4f4b-881c-5ada3ea79751 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:20.686906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c84889-1054-4f4b-881c-5ada3ea79751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:20.690606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 668/1361] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:20 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:20.757922 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-31c84889-1054-4f4b-881c-5ada3ea79751 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:20.759060 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-31c84889-1054-4f4b-881c-5ada3ea79751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:20.797357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:20.866577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 694/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:20.910046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd744e7-9bd0-4f73-9604-767765368170 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:20.911574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7cd744e7-9bd0-4f73-9604-767765368170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:21.105771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd744e7-9bd0-4f73-9604-767765368170 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:21.118112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:21.268311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b07df-de51-456a-bf1a-d30580e9adf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:21.269161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b07df-de51-456a-bf1a-d30580e9adf4 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:21.269447 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b07df-de51-456a-bf1a-d30580e9adf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:21.269726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b07df-de51-456a-bf1a-d30580e9adf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:21.271421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a03b07df-de51-456a-bf1a-d30580e9adf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:21.365945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b07df-de51-456a-bf1a-d30580e9adf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:21.367577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b07df-de51-456a-bf1a-d30580e9adf4 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:21.386469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 669/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:23.782147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f12641-c046-46ad-9fae-b3715fa5eafe None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:23.783235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f12641-c046-46ad-9fae-b3715fa5eafe None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:23.783738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f12641-c046-46ad-9fae-b3715fa5eafe None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:23.785620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 695/1364] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:23.791508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7325ddc-1f71-418d-b169-8d2997a0dcc3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:23.791979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7325ddc-1f71-418d-b169-8d2997a0dcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:23.792073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7325ddc-1f71-418d-b169-8d2997a0dcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:23.818535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:23.884417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b7325ddc-1f71-418d-b169-8d2997a0dcc3 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:23.885648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b7325ddc-1f71-418d-b169-8d2997a0dcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:23.994552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 670/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:24.034082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47681c85-962d-495a-abfc-f14c937cc4ec None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:24.034565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47681c85-962d-495a-abfc-f14c937cc4ec None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:24.034946 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47681c85-962d-495a-abfc-f14c937cc4ec None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:24.036618 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 696/1366] 10.222.0.36 () {54 vars in 962 bytes} [Thu Jul 28 02:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:24.042062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16176e7-c8b6-4799-9721-295f5b328002 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:24.042363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16176e7-c8b6-4799-9721-295f5b328002 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:24.042679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16176e7-c8b6-4799-9721-295f5b328002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:24.127243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d16176e7-c8b6-4799-9721-295f5b328002 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:24.128872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d16176e7-c8b6-4799-9721-295f5b328002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:24.165345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:24.254122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 671/1367] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Jul 28 02:01:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:24.262228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47681c85-962d-495a-abfc-f14c937cc4ec None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:24.264056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-47681c85-962d-495a-abfc-f14c937cc4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:24.429254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47681c85-962d-495a-abfc-f14c937cc4ec None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:24.453828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:24.557909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69650536-9a2d-406a-b1d6-d893c6fbf5aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:24.558469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650536-9a2d-406a-b1d6-d893c6fbf5aa service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:24.558745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650536-9a2d-406a-b1d6-d893c6fbf5aa service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:24.559018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650536-9a2d-406a-b1d6-d893c6fbf5aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:24.560634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-69650536-9a2d-406a-b1d6-d893c6fbf5aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:24.662985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69650536-9a2d-406a-b1d6-d893c6fbf5aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:24.664605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69650536-9a2d-406a-b1d6-d893c6fbf5aa service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:24.683695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 697/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:25.631947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f481a-fe9a-4866-b66e-3f9890d9477e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:25.632610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f481a-fe9a-4866-b66e-3f9890d9477e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:25.632610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f481a-fe9a-4866-b66e-3f9890d9477e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:25.633871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 672/1369] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:25.639204 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9da0-9e9e-480c-8a74-0e6cd1d8d2d6 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:25.639662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9da0-9e9e-480c-8a74-0e6cd1d8d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:25.639758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9da0-9e9e-480c-8a74-0e6cd1d8d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:25.674464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:25.710128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4f3b9da0-9e9e-480c-8a74-0e6cd1d8d2d6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:25.711373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4f3b9da0-9e9e-480c-8a74-0e6cd1d8d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:25.814241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 698/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:26.160213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9d38-1592-4e4c-857d-ea8bb7fa32e3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:26.160213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9d38-1592-4e4c-857d-ea8bb7fa32e3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:26.160213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9d38-1592-4e4c-857d-ea8bb7fa32e3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:26.162470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 673/1371] 10.222.0.36 () {54 vars in 964 bytes} [Thu Jul 28 02:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 02:01:26.167501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03286228-d2cb-4a84-8643-c467d7b48e88 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:26.167793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03286228-d2cb-4a84-8643-c467d7b48e88 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:26.168069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03286228-d2cb-4a84-8643-c467d7b48e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:26.269837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-03286228-d2cb-4a84-8643-c467d7b48e88 None None] MFA Rules not processed for user `983bd6880830419f9158b33411b57f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:26.271022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-03286228-d2cb-4a84-8643-c467d7b48e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:26.327393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:26.361189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 699/1372] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Jul 28 02:01:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:26.368835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea9d38-1592-4e4c-857d-ea8bb7fa32e3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:26.370325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e6ea9d38-1592-4e4c-857d-ea8bb7fa32e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:26.495594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea9d38-1592-4e4c-857d-ea8bb7fa32e3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:26.538995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:26.575495 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce830982-dc46-43bc-bf2d-0a66a40da3b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:26.576115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce830982-dc46-43bc-bf2d-0a66a40da3b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:26.576392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce830982-dc46-43bc-bf2d-0a66a40da3b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:26.576661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce830982-dc46-43bc-bf2d-0a66a40da3b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:26.578266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ce830982-dc46-43bc-bf2d-0a66a40da3b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:26.702623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce830982-dc46-43bc-bf2d-0a66a40da3b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:26.705266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce830982-dc46-43bc-bf2d-0a66a40da3b8 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:26.729853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 674/1373] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:26.777018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc8393-fea0-4120-a1f1-942f624cd850 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:26.777477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc8393-fea0-4120-a1f1-942f624cd850 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:26.777803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc8393-fea0-4120-a1f1-942f624cd850 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:26.779621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 700/1374] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:26.785005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89faef-87de-4550-ad8d-ee024ade5170 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:26.785395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89faef-87de-4550-ad8d-ee024ade5170 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:26.785772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89faef-87de-4550-ad8d-ee024ade5170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:26.863238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8b89faef-87de-4550-ad8d-ee024ade5170 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:26.863238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8b89faef-87de-4550-ad8d-ee024ade5170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:26.884690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:26.967213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 675/1375] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:27.016386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc8393-fea0-4120-a1f1-942f624cd850 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:27.018322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-93cc8393-fea0-4120-a1f1-942f624cd850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:27.191062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc8393-fea0-4120-a1f1-942f624cd850 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:27.242087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:27.302600 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1173678-b2c2-46e1-879d-8ee4179d4e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:27.303211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173678-b2c2-46e1-879d-8ee4179d4e49 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:27.303486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173678-b2c2-46e1-879d-8ee4179d4e49 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:27.303759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173678-b2c2-46e1-879d-8ee4179d4e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:27.305361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f1173678-b2c2-46e1-879d-8ee4179d4e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:27.393896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1173678-b2c2-46e1-879d-8ee4179d4e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:27.395541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1173678-b2c2-46e1-879d-8ee4179d4e49 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:27.414920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 701/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:29.448082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f069ee-f7cc-46c6-9928-c523e46b1e9c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:29.448515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f069ee-f7cc-46c6-9928-c523e46b1e9c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:29.448642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f069ee-f7cc-46c6-9928-c523e46b1e9c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:29.450018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 676/1377] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:29.455826 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b53dc-67d9-48c0-bfb4-c662b34aafc4 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:29.456240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b53dc-67d9-48c0-bfb4-c662b34aafc4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:29.456369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b53dc-67d9-48c0-bfb4-c662b34aafc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:29.523158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-634b53dc-67d9-48c0-bfb4-c662b34aafc4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:29.524366 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-634b53dc-67d9-48c0-bfb4-c662b34aafc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:29.531143 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:29.639125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 702/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:01:29.683972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f069ee-f7cc-46c6-9928-c523e46b1e9c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:29.685535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-97f069ee-f7cc-46c6-9928-c523e46b1e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:29.861026 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f069ee-f7cc-46c6-9928-c523e46b1e9c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:29.865368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:29.991562 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b8a90-3caf-4174-8ff6-8a0860d5b44a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:29.992272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b8a90-3caf-4174-8ff6-8a0860d5b44a service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:29.992626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b8a90-3caf-4174-8ff6-8a0860d5b44a service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:29.992902 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b8a90-3caf-4174-8ff6-8a0860d5b44a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:29.994565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-032b8a90-3caf-4174-8ff6-8a0860d5b44a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:30.103573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b8a90-3caf-4174-8ff6-8a0860d5b44a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:30.105302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b8a90-3caf-4174-8ff6-8a0860d5b44a service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:30.124670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 677/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:32.186877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f7e3b-fee8-4b30-9c02-2f2a91fb81c5 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:32.187386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f7e3b-fee8-4b30-9c02-2f2a91fb81c5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:32.187386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f7e3b-fee8-4b30-9c02-2f2a91fb81c5 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:32.189349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 703/1380] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:32.194877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cdab3-ce54-4d93-9f53-1d5cb0f0d18e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:32.195282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cdab3-ce54-4d93-9f53-1d5cb0f0d18e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:32.195500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cdab3-ce54-4d93-9f53-1d5cb0f0d18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:32.207132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:32.274711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cb0cdab3-ce54-4d93-9f53-1d5cb0f0d18e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:32.275932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cb0cdab3-ce54-4d93-9f53-1d5cb0f0d18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:32.382479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 678/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:32.423962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f7e3b-fee8-4b30-9c02-2f2a91fb81c5 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:32.425545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-345f7e3b-fee8-4b30-9c02-2f2a91fb81c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:32.577444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:32.589069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f7e3b-fee8-4b30-9c02-2f2a91fb81c5 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:32.707904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a183-bae4-4487-9a5a-c4c143d96598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:32.708516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a183-bae4-4487-9a5a-c4c143d96598 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:32.708789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a183-bae4-4487-9a5a-c4c143d96598 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:32.709055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a183-bae4-4487-9a5a-c4c143d96598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:32.710691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2a11a183-bae4-4487-9a5a-c4c143d96598 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:32.804010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11a183-bae4-4487-9a5a-c4c143d96598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:32.805599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11a183-bae4-4487-9a5a-c4c143d96598 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:32.816860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:32.826185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 704/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:35.076931 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14717-7595-4089-b3fb-a801e1da38f3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:35.077464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14717-7595-4089-b3fb-a801e1da38f3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:35.077687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14717-7595-4089-b3fb-a801e1da38f3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:35.079615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 679/1383] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:35.085004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d14e6-b55f-409c-b26d-c2c3231e99b4 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:35.085543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d14e6-b55f-409c-b26d-c2c3231e99b4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:35.085543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d14e6-b55f-409c-b26d-c2c3231e99b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:35.152234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-228d14e6-b55f-409c-b26d-c2c3231e99b4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:35.153369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-228d14e6-b55f-409c-b26d-c2c3231e99b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:35.253670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 705/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:35.296089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad14717-7595-4089-b3fb-a801e1da38f3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:35.297679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3ad14717-7595-4089-b3fb-a801e1da38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:35.400109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:35.464969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad14717-7595-4089-b3fb-a801e1da38f3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:35.581988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd9d91-ed02-4af4-bab1-191e8acfe110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:35.582648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd9d91-ed02-4af4-bab1-191e8acfe110 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:35.582929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd9d91-ed02-4af4-bab1-191e8acfe110 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:35.583205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd9d91-ed02-4af4-bab1-191e8acfe110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:35.584857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d1bd9d91-ed02-4af4-bab1-191e8acfe110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:35.647924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:35.690694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd9d91-ed02-4af4-bab1-191e8acfe110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:35.692555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd9d91-ed02-4af4-bab1-191e8acfe110 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:35.711588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 680/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:37.726992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42b3ab-d76c-4e97-96c8-1c5c92f74411 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:37.727511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42b3ab-d76c-4e97-96c8-1c5c92f74411 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:37.727511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42b3ab-d76c-4e97-96c8-1c5c92f74411 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:37.728837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 706/1386] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:37.734490 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6f7a3-30d5-4dce-9121-ab07f2e7d775 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:37.734929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6f7a3-30d5-4dce-9121-ab07f2e7d775 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:37.735223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6f7a3-30d5-4dce-9121-ab07f2e7d775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:37.819778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-09b6f7a3-30d5-4dce-9121-ab07f2e7d775 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:37.821401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-09b6f7a3-30d5-4dce-9121-ab07f2e7d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:37.927339 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 681/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:37.973508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42b3ab-d76c-4e97-96c8-1c5c92f74411 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:37.975089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2e42b3ab-d76c-4e97-96c8-1c5c92f74411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:38.064742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:38.135295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42b3ab-d76c-4e97-96c8-1c5c92f74411 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:38.252287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2edb-71bd-48bf-893b-9ebf8d547c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:38.252909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2edb-71bd-48bf-893b-9ebf8d547c1a service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:38.253187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2edb-71bd-48bf-893b-9ebf8d547c1a service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:38.253462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2edb-71bd-48bf-893b-9ebf8d547c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:38.255132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0bfe2edb-71bd-48bf-893b-9ebf8d547c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:38.296963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:38.355834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2edb-71bd-48bf-893b-9ebf8d547c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:38.357463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2edb-71bd-48bf-893b-9ebf8d547c1a service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:38.376549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 707/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:40.623658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc87e4-0f23-4c48-a2a1-c8b865bad2c2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:40.624192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc87e4-0f23-4c48-a2a1-c8b865bad2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:40.624192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc87e4-0f23-4c48-a2a1-c8b865bad2c2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:40.625750 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 682/1389] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:40.631780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c999a-e715-4ca1-85a6-0b44ef842d53 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:40.632207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c999a-e715-4ca1-85a6-0b44ef842d53 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:40.632396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c999a-e715-4ca1-85a6-0b44ef842d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:40.698746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-563c999a-e715-4ca1-85a6-0b44ef842d53 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:40.699943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-563c999a-e715-4ca1-85a6-0b44ef842d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:40.798158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 708/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:40.844767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc87e4-0f23-4c48-a2a1-c8b865bad2c2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:40.846344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c1fc87e4-0f23-4c48-a2a1-c8b865bad2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:40.879459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:40.995059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc87e4-0f23-4c48-a2a1-c8b865bad2c2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:41.095597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:41.107153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915819f-0cf1-4d23-afdf-c0cd1574ffb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:41.107766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915819f-0cf1-4d23-afdf-c0cd1574ffb8 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:41.108041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915819f-0cf1-4d23-afdf-c0cd1574ffb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:41.108309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915819f-0cf1-4d23-afdf-c0cd1574ffb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:41.109926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6915819f-0cf1-4d23-afdf-c0cd1574ffb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:41.200236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915819f-0cf1-4d23-afdf-c0cd1574ffb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:41.201751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915819f-0cf1-4d23-afdf-c0cd1574ffb8 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:41.219577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 683/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:41.746598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee43c8f-39f1-4492-99c3-e3a1bc9c5610 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:41.747151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee43c8f-39f1-4492-99c3-e3a1bc9c5610 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:41.747151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee43c8f-39f1-4492-99c3-e3a1bc9c5610 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:41.748490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 709/1392] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:41.753525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce153b90-feb1-490b-98d6-e0edd85858f8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:41.753947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce153b90-feb1-490b-98d6-e0edd85858f8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:41.754082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce153b90-feb1-490b-98d6-e0edd85858f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:41.819680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ce153b90-feb1-490b-98d6-e0edd85858f8 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:41.820903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ce153b90-feb1-490b-98d6-e0edd85858f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:41.880215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:41.920546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 684/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:41.976479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3402-5831-40c0-a755-5329e86b7583 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:41.976768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3402-5831-40c0-a755-5329e86b7583 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:41.977047 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3402-5831-40c0-a755-5329e86b7583 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:41.978401 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 710/1394] 10.222.0.36 () {54 vars in 966 bytes} [Thu Jul 28 02:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:41.983476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445fcca-0e3f-4932-a420-02c9c44f1811 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:41.983767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445fcca-0e3f-4932-a420-02c9c44f1811 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:41.984042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445fcca-0e3f-4932-a420-02c9c44f1811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:42.059930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6445fcca-0e3f-4932-a420-02c9c44f1811 None None] MFA Rules not processed for user `ece4e0b16a9441b5ba14bbc8ff1c632c`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:42.061132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6445fcca-0e3f-4932-a420-02c9c44f1811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:42.137258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 685/1395] 10.222.0.36 () {58 vars in 1063 bytes} [Thu Jul 28 02:01:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:42.145448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee3402-5831-40c0-a755-5329e86b7583 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:42.146982 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a1ee3402-5831-40c0-a755-5329e86b7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:42.161408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:42.251190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee3402-5831-40c0-a755-5329e86b7583 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:42.324970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea30f-37b5-4feb-b08e-61db94918cd4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece4e0b16a9441b5ba14bbc8ff1c632c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:42.325581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea30f-37b5-4feb-b08e-61db94918cd4 service glance] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:42.325858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea30f-37b5-4feb-b08e-61db94918cd4 service glance] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:42.326129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea30f-37b5-4feb-b08e-61db94918cd4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:42.327761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-631ea30f-37b5-4feb-b08e-61db94918cd4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:42.397596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:42.437868 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ea30f-37b5-4feb-b08e-61db94918cd4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:42.439859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ea30f-37b5-4feb-b08e-61db94918cd4 service glance] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:42.458221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 711/1396] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:01:43.182482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591036-d313-4e6b-a145-5d2842853081 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:43.182946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591036-d313-4e6b-a145-5d2842853081 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:43.183039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591036-d313-4e6b-a145-5d2842853081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:43.251934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-86591036-d313-4e6b-a145-5d2842853081 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:43.253175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-86591036-d313-4e6b-a145-5d2842853081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:43.261606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:43.278976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a600b6-d2ca-4a00-baf5-6a093499f36b None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:43.279507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a600b6-d2ca-4a00-baf5-6a093499f36b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:43.279635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a600b6-d2ca-4a00-baf5-6a093499f36b None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:43.280953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 712/1397] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 02:01:43.286901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8292f-bcbc-4a7e-a144-734163c26624 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:43.287186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8292f-bcbc-4a7e-a144-734163c26624 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:43.287477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8292f-bcbc-4a7e-a144-734163c26624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:43.343023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 686/1398] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:01:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:43.354128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-10f8292f-bcbc-4a7e-a144-734163c26624 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:43.355372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-10f8292f-bcbc-4a7e-a144-734163c26624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:43.390077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79760128-a82a-44ad-b88d-0e764bd19d6d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:43.390366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79760128-a82a-44ad-b88d-0e764bd19d6d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:43.390697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79760128-a82a-44ad-b88d-0e764bd19d6d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:43.392667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 687/1399] 10.222.0.36 () {54 vars in 943 bytes} [Thu Jul 28 02:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 02:01:43.398827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a22a1-f118-42e1-8988-e45507d6169a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:43.399113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a22a1-f118-42e1-8988-e45507d6169a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:43.399418 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a22a1-f118-42e1-8988-e45507d6169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:43.452967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 713/1400] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:01:43.476719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d84a22a1-f118-42e1-8988-e45507d6169a None None] MFA Rules not processed for user `a891bb14f40d403b90915115bc487b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:43.477915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d84a22a1-f118-42e1-8988-e45507d6169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:43.498053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8292f-bcbc-4a7e-a144-734163c26624 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:43.499279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-10f8292f-bcbc-4a7e-a144-734163c26624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:43.525517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:43.564125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:43.587661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 688/1401] 10.222.0.36 () {58 vars in 1040 bytes} [Thu Jul 28 02:01:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:01:43.597552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a22a1-f118-42e1-8988-e45507d6169a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:43.606945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a22a1-f118-42e1-8988-e45507d6169a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:43.617379 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8292f-bcbc-4a7e-a144-734163c26624 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:43.722739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77a883-3885-49b9-b200-5992ceddddc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:43.723271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77a883-3885-49b9-b200-5992ceddddc4 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:43.723547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77a883-3885-49b9-b200-5992ceddddc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:43.723817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77a883-3885-49b9-b200-5992ceddddc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:43.725465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-be77a883-3885-49b9-b200-5992ceddddc4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:43.742450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489660d-d24a-4c0b-b96d-18616302f665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:43.743080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489660d-d24a-4c0b-b96d-18616302f665 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:43.743360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489660d-d24a-4c0b-b96d-18616302f665 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:43.743631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489660d-d24a-4c0b-b96d-18616302f665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:43.745234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c489660d-d24a-4c0b-b96d-18616302f665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:43.776439 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:43.816624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77a883-3885-49b9-b200-5992ceddddc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:43.818204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77a883-3885-49b9-b200-5992ceddddc4 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:43.826464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 689/1402] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:01:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 02:01:43.854393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489660d-d24a-4c0b-b96d-18616302f665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:43.856401 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489660d-d24a-4c0b-b96d-18616302f665 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:43.881351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 714/1403] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:01:45.950723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae98d-942c-44e7-a1f2-c1e4aee09345 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:45.951312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae98d-942c-44e7-a1f2-c1e4aee09345 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:45.951312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae98d-942c-44e7-a1f2-c1e4aee09345 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:45.952642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 690/1404] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:45.957859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf1ff-8051-4010-b4d2-83c317ccab4b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:45.958285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf1ff-8051-4010-b4d2-83c317ccab4b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:45.958518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf1ff-8051-4010-b4d2-83c317ccab4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:46.032747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-63cdf1ff-8051-4010-b4d2-83c317ccab4b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:46.033981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-63cdf1ff-8051-4010-b4d2-83c317ccab4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:46.139127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:46.154598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 715/1405] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:01:46.192891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae98d-942c-44e7-a1f2-c1e4aee09345 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:46.194402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d8bae98d-942c-44e7-a1f2-c1e4aee09345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:46.205718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:46.367690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae98d-942c-44e7-a1f2-c1e4aee09345 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:46.464529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:46.501837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f11678-e7cf-4047-8dfd-710513bf44ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:46.502483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f11678-e7cf-4047-8dfd-710513bf44ee service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:46.502773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f11678-e7cf-4047-8dfd-710513bf44ee service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:46.504785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f11678-e7cf-4047-8dfd-710513bf44ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:46.506484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c7f11678-e7cf-4047-8dfd-710513bf44ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:46.613117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f11678-e7cf-4047-8dfd-710513bf44ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:46.614802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f11678-e7cf-4047-8dfd-710513bf44ee service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:46.645420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 691/1406] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:48.744974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0c6c2-bace-48b3-aa09-8a0806bcaebf None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:48.745580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0c6c2-bace-48b3-aa09-8a0806bcaebf None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:48.745580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0c6c2-bace-48b3-aa09-8a0806bcaebf None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:48.751353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 716/1407] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:01:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:01:48.752622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3662976-14ca-4392-b8a0-e3dfeb0b6fdd None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:48.753022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3662976-14ca-4392-b8a0-e3dfeb0b6fdd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:48.753171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3662976-14ca-4392-b8a0-e3dfeb0b6fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:48.833045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f3662976-14ca-4392-b8a0-e3dfeb0b6fdd None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:01:48.834288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f3662976-14ca-4392-b8a0-e3dfeb0b6fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:48.886281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:48.937380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 692/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:01:48.981721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0c6c2-bace-48b3-aa09-8a0806bcaebf None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:01:48.983278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-94d0c6c2-bace-48b3-aa09-8a0806bcaebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:49.151445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0c6c2-bace-48b3-aa09-8a0806bcaebf None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:01:49.231410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:49.284018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e6e8d-732f-4ea0-8a04-9e33ba5cc1c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:01:49.284642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6e8d-732f-4ea0-8a04-9e33ba5cc1c1 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:01:49.284925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6e8d-732f-4ea0-8a04-9e33ba5cc1c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:01:49.285201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6e8d-732f-4ea0-8a04-9e33ba5cc1c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:01:49.286921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f05e6e8d-732f-4ea0-8a04-9e33ba5cc1c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:01:49.389514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e6e8d-732f-4ea0-8a04-9e33ba5cc1c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:01:49.392040 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e6e8d-732f-4ea0-8a04-9e33ba5cc1c1 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:01:49.412238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 717/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:01:58.935358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=23 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:01:59.408274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=64 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:05.901326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290524-2438-4ca5-ae45-76a875bd1c85 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:05.901794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290524-2438-4ca5-ae45-76a875bd1c85 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:05.901896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290524-2438-4ca5-ae45-76a875bd1c85 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:05.903322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 693/1410] 10.222.0.36 () {54 vars in 918 bytes} [Thu Jul 28 02:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:05.908426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca010e3-5112-4809-b20e-d686fe894842 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:05.908855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca010e3-5112-4809-b20e-d686fe894842 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:05.908983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca010e3-5112-4809-b20e-d686fe894842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:05.982895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9ca010e3-5112-4809-b20e-d686fe894842 None None] MFA Rules not processed for user `e041d38c69cd4626898bc1412f5ed1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:05.984603 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9ca010e3-5112-4809-b20e-d686fe894842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:06.090691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 718/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Jul 28 02:02:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:06.105144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2e24-fc06-48be-833f-d9251024894c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:06.105431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2e24-fc06-48be-833f-d9251024894c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:06.105708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2e24-fc06-48be-833f-d9251024894c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:06.107132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 694/1412] 10.222.0.36 () {54 vars in 918 bytes} [Thu Jul 28 02:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:06.112192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1198b-035e-4eab-a77e-b5a13a8881d0 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:06.112476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1198b-035e-4eab-a77e-b5a13a8881d0 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:06.112754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1198b-035e-4eab-a77e-b5a13a8881d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:06.184441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:06.188225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9fc1198b-035e-4eab-a77e-b5a13a8881d0 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:06.192632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9fc1198b-035e-4eab-a77e-b5a13a8881d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:06.304316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 719/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Jul 28 02:02:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:08.787751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994014ab-d70c-46d6-868c-0dfc2c311890 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:08.788284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994014ab-d70c-46d6-868c-0dfc2c311890 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:08.788284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994014ab-d70c-46d6-868c-0dfc2c311890 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:08.789550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:08.794783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325df6c-36d7-432a-b1f4-0cc32a0dcb8d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:08.795187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325df6c-36d7-432a-b1f4-0cc32a0dcb8d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:08.795339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325df6c-36d7-432a-b1f4-0cc32a0dcb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:08.861342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d325df6c-36d7-432a-b1f4-0cc32a0dcb8d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:08.862595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d325df6c-36d7-432a-b1f4-0cc32a0dcb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:08.917008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:08.959800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:09.003086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994014ab-d70c-46d6-868c-0dfc2c311890 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:09.004586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-994014ab-d70c-46d6-868c-0dfc2c311890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:09.147896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994014ab-d70c-46d6-868c-0dfc2c311890 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:09.219530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:09.260246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24853f-27a4-426c-89bb-563360fc0cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:09.260865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24853f-27a4-426c-89bb-563360fc0cf9 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:09.261146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24853f-27a4-426c-89bb-563360fc0cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:09.261420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24853f-27a4-426c-89bb-563360fc0cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:09.263094 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1f24853f-27a4-426c-89bb-563360fc0cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:09.351253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24853f-27a4-426c-89bb-563360fc0cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:09.352857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24853f-27a4-426c-89bb-563360fc0cf9 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:09.371271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 696/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:10.314223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d8e7-69bb-41bb-b54b-6e2e3941289b None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:10.315110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d8e7-69bb-41bb-b54b-6e2e3941289b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:10.315110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d8e7-69bb-41bb-b54b-6e2e3941289b None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:10.316420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:10.321599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96b0a-2e01-41c7-a7a8-a8304d564a16 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:10.322031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96b0a-2e01-41c7-a7a8-a8304d564a16 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:10.322145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96b0a-2e01-41c7-a7a8-a8304d564a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:10.400329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c0b96b0a-2e01-41c7-a7a8-a8304d564a16 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:10.401570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c0b96b0a-2e01-41c7-a7a8-a8304d564a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:10.429345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:10.514119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:10.706068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d8e7-69bb-41bb-b54b-6e2e3941289b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:10.707510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6ef3d8e7-69bb-41bb-b54b-6e2e3941289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:10.859564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d8e7-69bb-41bb-b54b-6e2e3941289b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:10.901142 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:10.975275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebdee4-41db-418f-916b-a82fe51ca67c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:10.975817 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebdee4-41db-418f-916b-a82fe51ca67c service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:10.976121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebdee4-41db-418f-916b-a82fe51ca67c service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:10.976390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebdee4-41db-418f-916b-a82fe51ca67c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:10.978001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-38ebdee4-41db-418f-916b-a82fe51ca67c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:11.066569 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebdee4-41db-418f-916b-a82fe51ca67c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:11.068182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebdee4-41db-418f-916b-a82fe51ca67c service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:11.085977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 722/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:11.980404 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f28b-d48c-4d94-af70-d2d2e40aa972 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:11.980404 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f28b-d48c-4d94-af70-d2d2e40aa972 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:11.981016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f28b-d48c-4d94-af70-d2d2e40aa972 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:11.982260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:11.987873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0db3-fa12-487f-affe-c63f7150af44 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:11.988297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0db3-fa12-487f-affe-c63f7150af44 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:11.988407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0db3-fa12-487f-affe-c63f7150af44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:12.043195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:12.069146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-6cfc0db3-fa12-487f-affe-c63f7150af44 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:12.070357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6cfc0db3-fa12-487f-affe-c63f7150af44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:12.165062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:12.317212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444f28b-d48c-4d94-af70-d2d2e40aa972 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:12.318749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f444f28b-d48c-4d94-af70-d2d2e40aa972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:12.463479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444f28b-d48c-4d94-af70-d2d2e40aa972 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:12.475975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:12.578156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add2327-ff9a-4dfb-8c45-8e9db3003f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:12.578821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add2327-ff9a-4dfb-8c45-8e9db3003f05 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:12.579097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add2327-ff9a-4dfb-8c45-8e9db3003f05 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:12.579366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add2327-ff9a-4dfb-8c45-8e9db3003f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:12.580978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0add2327-ff9a-4dfb-8c45-8e9db3003f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:12.669371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add2327-ff9a-4dfb-8c45-8e9db3003f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:12.670979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add2327-ff9a-4dfb-8c45-8e9db3003f05 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:12.688558 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 699/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:13.547112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f0a1-e556-4a3e-b23d-126b81f01fc4 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:13.547656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f0a1-e556-4a3e-b23d-126b81f01fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:13.547780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f0a1-e556-4a3e-b23d-126b81f01fc4 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:13.549054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:13.553838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad201c-ce71-4b1d-958a-10b7aac07b86 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:13.554277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad201c-ce71-4b1d-958a-10b7aac07b86 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:13.554375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad201c-ce71-4b1d-958a-10b7aac07b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:13.574027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:13.629260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4cad201c-ce71-4b1d-958a-10b7aac07b86 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:13.630644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4cad201c-ce71-4b1d-958a-10b7aac07b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:13.726528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:13.884488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745f0a1-e556-4a3e-b23d-126b81f01fc4 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:13.886087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3745f0a1-e556-4a3e-b23d-126b81f01fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:13.993999 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:14.030831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745f0a1-e556-4a3e-b23d-126b81f01fc4 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:14.144203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33166392-6a91-48a8-a8bc-9e2edf20544b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:14.144743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33166392-6a91-48a8-a8bc-9e2edf20544b service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:14.145024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33166392-6a91-48a8-a8bc-9e2edf20544b service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:14.145298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33166392-6a91-48a8-a8bc-9e2edf20544b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:14.146951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-33166392-6a91-48a8-a8bc-9e2edf20544b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:14.221348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:14.235478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33166392-6a91-48a8-a8bc-9e2edf20544b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:14.237101 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33166392-6a91-48a8-a8bc-9e2edf20544b service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:14.255367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 725/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:15.109284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65974cab-3c4a-496b-8830-e89d357babd8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:15.109788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65974cab-3c4a-496b-8830-e89d357babd8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:15.109894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65974cab-3c4a-496b-8830-e89d357babd8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:15.111283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:15.116133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f8204-1643-4947-b12d-d05064d126bf None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:15.116605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f8204-1643-4947-b12d-d05064d126bf None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:15.116702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f8204-1643-4947-b12d-d05064d126bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:15.191975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-028f8204-1643-4947-b12d-d05064d126bf None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:15.193110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-028f8204-1643-4947-b12d-d05064d126bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:15.287519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:15.434677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65974cab-3c4a-496b-8830-e89d357babd8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:15.436242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-65974cab-3c4a-496b-8830-e89d357babd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:15.520197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:15.581852 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65974cab-3c4a-496b-8830-e89d357babd8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:15.693019 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944c1eb-7645-4933-86e0-32f49a59543b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:15.693635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944c1eb-7645-4933-86e0-32f49a59543b service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:15.693914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944c1eb-7645-4933-86e0-32f49a59543b service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:15.694188 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944c1eb-7645-4933-86e0-32f49a59543b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:15.695828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c944c1eb-7645-4933-86e0-32f49a59543b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:15.742709 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:15.788460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944c1eb-7645-4933-86e0-32f49a59543b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:15.790008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944c1eb-7645-4933-86e0-32f49a59543b service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:15.808547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 702/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:16.618287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e0d47-7451-4d8b-b84c-3f691e0daa93 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:16.618897 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e0d47-7451-4d8b-b84c-3f691e0daa93 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:16.618897 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e0d47-7451-4d8b-b84c-3f691e0daa93 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:16.620229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:16.624987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c63d-3a67-4082-8742-c756695cbd57 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:16.625431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c63d-3a67-4082-8742-c756695cbd57 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:16.625541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c63d-3a67-4082-8742-c756695cbd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:16.700683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7a43c63d-3a67-4082-8742-c756695cbd57 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:16.701880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7a43c63d-3a67-4082-8742-c756695cbd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:16.798600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:16.949841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e0d47-7451-4d8b-b84c-3f691e0daa93 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:16.951399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-228e0d47-7451-4d8b-b84c-3f691e0daa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:16.999639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:17.098661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e0d47-7451-4d8b-b84c-3f691e0daa93 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:17.209926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fe935-7036-4482-a906-6763e855f229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:17.210491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fe935-7036-4482-a906-6763e855f229 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:17.210774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fe935-7036-4482-a906-6763e855f229 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:17.211049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fe935-7036-4482-a906-6763e855f229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:17.212671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-756fe935-7036-4482-a906-6763e855f229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:17.219436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:17.300053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fe935-7036-4482-a906-6763e855f229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:17.301647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fe935-7036-4482-a906-6763e855f229 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:17.320033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 728/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:18.126121 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69570-4d49-4652-97b4-c0b1f510e715 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:18.126723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69570-4d49-4652-97b4-c0b1f510e715 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:18.126723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69570-4d49-4652-97b4-c0b1f510e715 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:18.128224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:18.133011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340854b7-4d69-48e4-94da-baa551a11ca0 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:18.133473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340854b7-4d69-48e4-94da-baa551a11ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:18.133582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340854b7-4d69-48e4-94da-baa551a11ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:18.209708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-340854b7-4d69-48e4-94da-baa551a11ca0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:18.210944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-340854b7-4d69-48e4-94da-baa551a11ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:18.277848 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:18.305844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:02:18.454909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b69570-4d49-4652-97b4-c0b1f510e715 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:18.456325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e9b69570-4d49-4652-97b4-c0b1f510e715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:18.473401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:18.613588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b69570-4d49-4652-97b4-c0b1f510e715 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:18.703894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:18.731485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d4159-502d-44c1-97b6-fa3d6df4eef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:18.732023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d4159-502d-44c1-97b6-fa3d6df4eef1 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:18.732302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d4159-502d-44c1-97b6-fa3d6df4eef1 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:18.732574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d4159-502d-44c1-97b6-fa3d6df4eef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:18.734225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ee6d4159-502d-44c1-97b6-fa3d6df4eef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:18.833469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d4159-502d-44c1-97b6-fa3d6df4eef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:18.835097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d4159-502d-44c1-97b6-fa3d6df4eef1 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:18.853930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 705/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:19.683994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc04b98-6802-438d-9368-7f406df79c34 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:19.684559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc04b98-6802-438d-9368-7f406df79c34 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:19.684559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc04b98-6802-438d-9368-7f406df79c34 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:19.685929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:19.690766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bd571-ca99-4fe0-9b52-54b92944f770 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:19.691420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bd571-ca99-4fe0-9b52-54b92944f770 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:19.691588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bd571-ca99-4fe0-9b52-54b92944f770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:19.767622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-df3bd571-ca99-4fe0-9b52-54b92944f770 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:19.768720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-df3bd571-ca99-4fe0-9b52-54b92944f770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:19.808625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:19.864297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:20.021916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc04b98-6802-438d-9368-7f406df79c34 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:20.023365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8bc04b98-6802-438d-9368-7f406df79c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:20.169876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc04b98-6802-438d-9368-7f406df79c34 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:20.224750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:20.282379 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a894b2-5b78-4981-86ba-8094ee6d8aec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:20.282951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a894b2-5b78-4981-86ba-8094ee6d8aec service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:20.283249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a894b2-5b78-4981-86ba-8094ee6d8aec service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:20.283505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a894b2-5b78-4981-86ba-8094ee6d8aec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:20.285119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-02a894b2-5b78-4981-86ba-8094ee6d8aec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:20.373283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a894b2-5b78-4981-86ba-8094ee6d8aec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:20.374914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a894b2-5b78-4981-86ba-8094ee6d8aec service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:20.393140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 731/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:21.197842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143051-9719-4285-bb9b-3055bb2cdc4a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:21.198371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143051-9719-4285-bb9b-3055bb2cdc4a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:21.198371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143051-9719-4285-bb9b-3055bb2cdc4a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:21.199777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:21.204617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4ffe-5573-46a6-bc56-aeae54e6bc1b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:21.205070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4ffe-5573-46a6-bc56-aeae54e6bc1b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:21.205193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4ffe-5573-46a6-bc56-aeae54e6bc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:21.280176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-bcec4ffe-5573-46a6-bc56-aeae54e6bc1b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:21.281363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-bcec4ffe-5573-46a6-bc56-aeae54e6bc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:21.283902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:21.378725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:21.526479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143051-9719-4285-bb9b-3055bb2cdc4a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:21.527923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a0143051-9719-4285-bb9b-3055bb2cdc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:21.672719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143051-9719-4285-bb9b-3055bb2cdc4a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:21.703093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:21.789585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971cb8e-9913-40b8-9f9c-202ad5888c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:21.790128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971cb8e-9913-40b8-9f9c-202ad5888c6c service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:21.790402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971cb8e-9913-40b8-9f9c-202ad5888c6c service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:21.790710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971cb8e-9913-40b8-9f9c-202ad5888c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:21.792359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5971cb8e-9913-40b8-9f9c-202ad5888c6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:21.880176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971cb8e-9913-40b8-9f9c-202ad5888c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:21.881794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971cb8e-9913-40b8-9f9c-202ad5888c6c service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:21.901544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 708/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:23.810507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de185cc4-bbd3-498b-91a5-72f5f7102387 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:23.811032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de185cc4-bbd3-498b-91a5-72f5f7102387 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:23.811032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de185cc4-bbd3-498b-91a5-72f5f7102387 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:23.812423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 02:02:23.818072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9bbb2-2e5d-40df-b6ba-ea42e06cfb7c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:23.818569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9bbb2-2e5d-40df-b6ba-ea42e06cfb7c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:23.818673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9bbb2-2e5d-40df-b6ba-ea42e06cfb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:23.861389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:23.887733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c8b9bbb2-2e5d-40df-b6ba-ea42e06cfb7c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:23.888964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c8b9bbb2-2e5d-40df-b6ba-ea42e06cfb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:23.985874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:24.024106 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de185cc4-bbd3-498b-91a5-72f5f7102387 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:24.025670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-de185cc4-bbd3-498b-91a5-72f5f7102387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:24.127097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de185cc4-bbd3-498b-91a5-72f5f7102387 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:24.159079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:24.199537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67625425-259d-4314-9bc3-5cbff72d2d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:24.200147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625425-259d-4314-9bc3-5cbff72d2d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:24.200427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625425-259d-4314-9bc3-5cbff72d2d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:24.200699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625425-259d-4314-9bc3-5cbff72d2d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:24.202317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-67625425-259d-4314-9bc3-5cbff72d2d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:24.309608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67625425-259d-4314-9bc3-5cbff72d2d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:24.311097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67625425-259d-4314-9bc3-5cbff72d2d3f service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:24.330076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 734/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:26.493232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093b59-129f-4153-a709-097bb7f19c45 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:26.493749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093b59-129f-4153-a709-097bb7f19c45 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:26.493749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093b59-129f-4153-a709-097bb7f19c45 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:26.495151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:26.501031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08262f9-341a-444f-b85a-57dbcfaea29d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:26.501582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08262f9-341a-444f-b85a-57dbcfaea29d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:26.501864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08262f9-341a-444f-b85a-57dbcfaea29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:26.572046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a08262f9-341a-444f-b85a-57dbcfaea29d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:26.573239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a08262f9-341a-444f-b85a-57dbcfaea29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:26.585577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:26.786839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:26.825005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093b59-129f-4153-a709-097bb7f19c45 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:26.826549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8c093b59-129f-4153-a709-097bb7f19c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:26.931172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093b59-129f-4153-a709-097bb7f19c45 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:26.943304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:27.003168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec760a6-bcc4-4995-bb8f-765f2cb844c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:27.003776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec760a6-bcc4-4995-bb8f-765f2cb844c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:27.004053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec760a6-bcc4-4995-bb8f-765f2cb844c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:27.004324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec760a6-bcc4-4995-bb8f-765f2cb844c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:27.005934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dec760a6-bcc4-4995-bb8f-765f2cb844c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:27.113399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec760a6-bcc4-4995-bb8f-765f2cb844c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:27.114871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec760a6-bcc4-4995-bb8f-765f2cb844c4 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:27.132515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 711/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:29.642411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b1b7-1985-452f-bf94-fbcd98e5149b None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:29.642985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b1b7-1985-452f-bf94-fbcd98e5149b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:29.642985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b1b7-1985-452f-bf94-fbcd98e5149b None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:29.644460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:29.649456 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e436958-f94d-42c1-958c-e838c88f014f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:29.649834 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e436958-f94d-42c1-958c-e838c88f014f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:29.650004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e436958-f94d-42c1-958c-e838c88f014f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:29.697576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:29.715849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5e436958-f94d-42c1-958c-e838c88f014f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:29.717045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5e436958-f94d-42c1-958c-e838c88f014f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:29.810685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:29.849865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b1b7-1985-452f-bf94-fbcd98e5149b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:29.851497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c123b1b7-1985-452f-bf94-fbcd98e5149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:29.966911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b1b7-1985-452f-bf94-fbcd98e5149b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:30.006190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:30.038846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a8536-0729-4fdf-9535-2757ee59dde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:30.039481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a8536-0729-4fdf-9535-2757ee59dde3 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:30.039758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a8536-0729-4fdf-9535-2757ee59dde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:30.040028 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a8536-0729-4fdf-9535-2757ee59dde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:30.041638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8c4a8536-0729-4fdf-9535-2757ee59dde3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:30.148145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a8536-0729-4fdf-9535-2757ee59dde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:30.149589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a8536-0729-4fdf-9535-2757ee59dde3 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:30.167234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 737/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:32.309613 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e24f1d-a54a-47e0-88c6-03ff439a033e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:32.310125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e24f1d-a54a-47e0-88c6-03ff439a033e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:32.310125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e24f1d-a54a-47e0-88c6-03ff439a033e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:32.311550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:32.317588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c87c8-9d88-43cc-87d8-7de15324281c None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:32.318041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c87c8-9d88-43cc-87d8-7de15324281c None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:32.318149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c87c8-9d88-43cc-87d8-7de15324281c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:32.382809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-096c87c8-9d88-43cc-87d8-7de15324281c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:32.383996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-096c87c8-9d88-43cc-87d8-7de15324281c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:32.404961 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:32.481131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:02:32.520351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e24f1d-a54a-47e0-88c6-03ff439a033e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:32.521868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e0e24f1d-a54a-47e0-88c6-03ff439a033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:32.623498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e24f1d-a54a-47e0-88c6-03ff439a033e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:32.644039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:32.698014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14711b-a4bd-4723-a811-247501c3fe96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:32.698716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14711b-a4bd-4723-a811-247501c3fe96 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:32.698991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14711b-a4bd-4723-a811-247501c3fe96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:32.699259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14711b-a4bd-4723-a811-247501c3fe96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:32.700840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cd14711b-a4bd-4723-a811-247501c3fe96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:32.805646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14711b-a4bd-4723-a811-247501c3fe96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:32.807089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14711b-a4bd-4723-a811-247501c3fe96 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:32.825623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 714/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:34.882361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae27bbe-c43c-4678-8e0c-8995dd6db7ff None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:34.882842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae27bbe-c43c-4678-8e0c-8995dd6db7ff None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:34.882945 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae27bbe-c43c-4678-8e0c-8995dd6db7ff None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:34.884315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:34.889567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300fc6e-434f-41b9-af5f-4148245f99b6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:34.889989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300fc6e-434f-41b9-af5f-4148245f99b6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:34.890119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300fc6e-434f-41b9-af5f-4148245f99b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:34.953286 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:34.955979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7300fc6e-434f-41b9-af5f-4148245f99b6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:34.957669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7300fc6e-434f-41b9-af5f-4148245f99b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:35.052093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:35.089313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae27bbe-c43c-4678-8e0c-8995dd6db7ff None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:35.090852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8ae27bbe-c43c-4678-8e0c-8995dd6db7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:35.192154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae27bbe-c43c-4678-8e0c-8995dd6db7ff None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:35.239234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:35.262874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de1364-4ce7-4c87-9630-763caa9aa80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:35.263474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de1364-4ce7-4c87-9630-763caa9aa80e service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:35.263747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de1364-4ce7-4c87-9630-763caa9aa80e service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:35.264015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de1364-4ce7-4c87-9630-763caa9aa80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:35.265612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b5de1364-4ce7-4c87-9630-763caa9aa80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:35.372928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de1364-4ce7-4c87-9630-763caa9aa80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:35.374360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de1364-4ce7-4c87-9630-763caa9aa80e service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:35.392388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 740/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:37.478210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40d9cf-cff9-4389-8074-92b6808230cf None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:37.478783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40d9cf-cff9-4389-8074-92b6808230cf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:37.478783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40d9cf-cff9-4389-8074-92b6808230cf None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:37.480173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:37.486042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43956f9-8182-496e-bc42-9e2cff82b16e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:37.486474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43956f9-8182-496e-bc42-9e2cff82b16e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:37.486621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43956f9-8182-496e-bc42-9e2cff82b16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:37.551740 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a43956f9-8182-496e-bc42-9e2cff82b16e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:37.552924 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a43956f9-8182-496e-bc42-9e2cff82b16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:37.581465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:37.647008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:37.684609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40d9cf-cff9-4389-8074-92b6808230cf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:37.686125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5a40d9cf-cff9-4389-8074-92b6808230cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:37.787427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40d9cf-cff9-4389-8074-92b6808230cf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:37.815426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:37.860438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f17d7-79a2-499b-83c7-3060fb48d4c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:37.861051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f17d7-79a2-499b-83c7-3060fb48d4c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:37.861324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f17d7-79a2-499b-83c7-3060fb48d4c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:37.861592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f17d7-79a2-499b-83c7-3060fb48d4c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:37.863238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6c4f17d7-79a2-499b-83c7-3060fb48d4c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:38.092466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f17d7-79a2-499b-83c7-3060fb48d4c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:38.094401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f17d7-79a2-499b-83c7-3060fb48d4c8 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:38.112477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 717/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:40.157453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c15f18-dc90-42f5-9732-00bd1226f5ae None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:40.157964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c15f18-dc90-42f5-9732-00bd1226f5ae None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:40.157964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c15f18-dc90-42f5-9732-00bd1226f5ae None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:40.159293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:40.164771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7546636-add2-47a7-8aff-ad0729303725 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:40.165175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7546636-add2-47a7-8aff-ad0729303725 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:40.165350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7546636-add2-47a7-8aff-ad0729303725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:40.230314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b7546636-add2-47a7-8aff-ad0729303725 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:40.231548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b7546636-add2-47a7-8aff-ad0729303725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:40.240309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:40.327570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:40.365185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c15f18-dc90-42f5-9732-00bd1226f5ae None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:40.366841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a0c15f18-dc90-42f5-9732-00bd1226f5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:40.467665 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c15f18-dc90-42f5-9732-00bd1226f5ae None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:40.521110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:40.539944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a1034-8ba6-485a-9270-c4f4dc9ba89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:40.540558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1034-8ba6-485a-9270-c4f4dc9ba89b service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:40.540836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1034-8ba6-485a-9270-c4f4dc9ba89b service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:40.541106 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1034-8ba6-485a-9270-c4f4dc9ba89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:40.542745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-5a6a1034-8ba6-485a-9270-c4f4dc9ba89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:40.660771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a1034-8ba6-485a-9270-c4f4dc9ba89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:40.662218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a1034-8ba6-485a-9270-c4f4dc9ba89b service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:40.680033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 743/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:42.731170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f514-d51b-4323-8899-f5876a316ed3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:42.731747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f514-d51b-4323-8899-f5876a316ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:42.731747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f514-d51b-4323-8899-f5876a316ed3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:42.733104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:42.738282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506843e-aa7a-4506-8db5-e11450632bc7 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:42.738756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506843e-aa7a-4506-8db5-e11450632bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:42.738901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506843e-aa7a-4506-8db5-e11450632bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:42.803494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-b506843e-aa7a-4506-8db5-e11450632bc7 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:42.804964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b506843e-aa7a-4506-8db5-e11450632bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:42.843823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:42.901497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:42.939172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f514-d51b-4323-8899-f5876a316ed3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:42.940750 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4588f514-d51b-4323-8899-f5876a316ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:43.052090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f514-d51b-4323-8899-f5876a316ed3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:43.089577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:43.125809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3c8d1-cd61-4bcd-8111-beb865f9947d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:43.126419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c8d1-cd61-4bcd-8111-beb865f9947d service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:43.126726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c8d1-cd61-4bcd-8111-beb865f9947d service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:43.126994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c8d1-cd61-4bcd-8111-beb865f9947d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:43.128604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8dd3c8d1-cd61-4bcd-8111-beb865f9947d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:43.235747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c8d1-cd61-4bcd-8111-beb865f9947d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:43.237218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c8d1-cd61-4bcd-8111-beb865f9947d service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:43.256980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 720/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:45.251714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef34985-9bcb-43dd-b82b-6922e5b7a520 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:45.252221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef34985-9bcb-43dd-b82b-6922e5b7a520 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:45.252221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef34985-9bcb-43dd-b82b-6922e5b7a520 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:45.253589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:45.258720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264c73-9074-4faa-9414-ef21188604e9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:45.259099 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264c73-9074-4faa-9414-ef21188604e9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:45.259267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264c73-9074-4faa-9414-ef21188604e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:45.330320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-38264c73-9074-4faa-9414-ef21188604e9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:45.331532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-38264c73-9074-4faa-9414-ef21188604e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:45.349061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:45.425485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:45.462494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef34985-9bcb-43dd-b82b-6922e5b7a520 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:45.464013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9ef34985-9bcb-43dd-b82b-6922e5b7a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:45.565420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef34985-9bcb-43dd-b82b-6922e5b7a520 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:45.632464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:45.639595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a0b06-1aff-4863-8a73-e104e61531bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:45.640225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a0b06-1aff-4863-8a73-e104e61531bb service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:45.640501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a0b06-1aff-4863-8a73-e104e61531bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:45.640767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a0b06-1aff-4863-8a73-e104e61531bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:45.642424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-458a0b06-1aff-4863-8a73-e104e61531bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:45.747745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a0b06-1aff-4863-8a73-e104e61531bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:45.749179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a0b06-1aff-4863-8a73-e104e61531bb service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:45.767399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 746/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:47.743543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008807a-a3d6-4340-9274-9bedef8de97c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:47.744077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008807a-a3d6-4340-9274-9bedef8de97c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:47.744077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008807a-a3d6-4340-9274-9bedef8de97c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:47.745442 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:02:47.751073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfae91-4ce6-4273-b9ee-da6346a92531 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:47.751494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfae91-4ce6-4273-b9ee-da6346a92531 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:47.751601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfae91-4ce6-4273-b9ee-da6346a92531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:47.816667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-6bdfae91-4ce6-4273-b9ee-da6346a92531 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:02:47.817858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6bdfae91-4ce6-4273-b9ee-da6346a92531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:47.865661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:47.912854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:02:47.949917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008807a-a3d6-4340-9274-9bedef8de97c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:02:47.951470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3008807a-a3d6-4340-9274-9bedef8de97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:48.065519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008807a-a3d6-4340-9274-9bedef8de97c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:02:48.111442 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:48.137276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2224058-c504-4b58-b222-ac05a2295e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:02:48.137886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2224058-c504-4b58-b222-ac05a2295e72 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:02:48.138159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2224058-c504-4b58-b222-ac05a2295e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:02:48.138424 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2224058-c504-4b58-b222-ac05a2295e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:02:48.140055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a2224058-c504-4b58-b222-ac05a2295e72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:02:48.246521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2224058-c504-4b58-b222-ac05a2295e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:02:48.247935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2224058-c504-4b58-b222-ac05a2295e72 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:02:48.265323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 723/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:02:57.911073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=22 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:02:58.263156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=66 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:07.544221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e0722-4860-4c11-a0cc-c9d0939cc4d4 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:07.544786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e0722-4860-4c11-a0cc-c9d0939cc4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:07.544786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e0722-4860-4c11-a0cc-c9d0939cc4d4 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:07.546055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 748/1471] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:03:07.551284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71908095-c654-4f08-9911-f5c0c0a1a988 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:07.551676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71908095-c654-4f08-9911-f5c0c0a1a988 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:07.551854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71908095-c654-4f08-9911-f5c0c0a1a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:07.617346 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-71908095-c654-4f08-9911-f5c0c0a1a988 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:03:07.618555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-71908095-c654-4f08-9911-f5c0c0a1a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:07.713190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 724/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:03:07.795499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290168d2-af88-4c93-b450-30b2c1a6a7c1 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:07.795724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290168d2-af88-4c93-b450-30b2c1a6a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:07.796001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290168d2-af88-4c93-b450-30b2c1a6a7c1 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:07.797342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 749/1473] 10.222.0.36 () {54 vars in 966 bytes} [Thu Jul 28 02:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:03:07.802230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81861-8bd2-4b7c-8b88-97796ae88813 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:07.802579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81861-8bd2-4b7c-8b88-97796ae88813 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:07.802868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81861-8bd2-4b7c-8b88-97796ae88813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:07.881417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-93c81861-8bd2-4b7c-8b88-97796ae88813 None None] MFA Rules not processed for user `ece4e0b16a9441b5ba14bbc8ff1c632c`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:03:07.882664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-93c81861-8bd2-4b7c-8b88-97796ae88813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:07.904487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:07.959856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 725/1474] 10.222.0.36 () {58 vars in 1063 bytes} [Thu Jul 28 02:03:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:03:07.975325 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290168d2-af88-4c93-b450-30b2c1a6a7c1 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:03:07.976836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-290168d2-af88-4c93-b450-30b2c1a6a7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:08.085606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290168d2-af88-4c93-b450-30b2c1a6a7c1 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:03:08.158625 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d964f3-633c-4c8a-9a9d-4723cef12e56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece4e0b16a9441b5ba14bbc8ff1c632c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:03:08.159240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d964f3-633c-4c8a-9a9d-4723cef12e56 service glance] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:08.159522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d964f3-633c-4c8a-9a9d-4723cef12e56 service glance] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:08.159798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d964f3-633c-4c8a-9a9d-4723cef12e56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:08.161422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-24d964f3-633c-4c8a-9a9d-4723cef12e56 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:08.216187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:08.271488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d964f3-633c-4c8a-9a9d-4723cef12e56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:03:08.272930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d964f3-633c-4c8a-9a9d-4723cef12e56 service glance] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:03:08.290911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 750/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:03:10.351342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1895-7527-4be6-b967-768cf9407d4f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:10.351895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1895-7527-4be6-b967-768cf9407d4f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:10.351895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1895-7527-4be6-b967-768cf9407d4f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:10.353273 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 726/1476] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:03:10.358369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd772f-67f5-4414-a478-08fd5a3fd24a None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:10.359364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd772f-67f5-4414-a478-08fd5a3fd24a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:10.359532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd772f-67f5-4414-a478-08fd5a3fd24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:10.423511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-43cd772f-67f5-4414-a478-08fd5a3fd24a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:03:10.424713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-43cd772f-67f5-4414-a478-08fd5a3fd24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:10.518400 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 751/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:03:10.541217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa1895-7527-4be6-b967-768cf9407d4f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:03:10.542766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-81aa1895-7527-4be6-b967-768cf9407d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:10.666711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa1895-7527-4be6-b967-768cf9407d4f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:03:10.714087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:10.758231 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95796efe-9ae2-47e6-9477-ae8874523572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:03:10.758870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95796efe-9ae2-47e6-9477-ae8874523572 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:10.759149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95796efe-9ae2-47e6-9477-ae8874523572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:10.759416 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95796efe-9ae2-47e6-9477-ae8874523572 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:10.760102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95796efe-9ae2-47e6-9477-ae8874523572 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:03:10.761811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-95796efe-9ae2-47e6-9477-ae8874523572 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:03:10.761811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: warnings.warn(msg) Jul 28 02:03:10.761811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: Jul 28 02:03:10.762977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95796efe-9ae2-47e6-9477-ae8874523572 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:03:10.782708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 727/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Jul 28 02:03:10 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:03:12.804411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deb00a-fd57-4774-b768-8856078786ec None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:12.804979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deb00a-fd57-4774-b768-8856078786ec None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:12.804979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deb00a-fd57-4774-b768-8856078786ec None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:12.806686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 752/1479] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:03:12.811914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9fe7-1c84-454d-aabb-3c4e7ae1189a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:12.812327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9fe7-1c84-454d-aabb-3c4e7ae1189a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:12.812450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9fe7-1c84-454d-aabb-3c4e7ae1189a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:12.877800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c9bc9fe7-1c84-454d-aabb-3c4e7ae1189a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:03:12.879048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c9bc9fe7-1c84-454d-aabb-3c4e7ae1189a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:12.975800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 728/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:03:13.018628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22deb00a-fd57-4774-b768-8856078786ec None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:03:13.020151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-22deb00a-fd57-4774-b768-8856078786ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:13.029781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:13.163959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22deb00a-fd57-4774-b768-8856078786ec None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:03:13.242884 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:13.275717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9ff69-4283-477d-a4ab-717cc957099e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:03:13.276324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9ff69-4283-477d-a4ab-717cc957099e service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:13.276596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9ff69-4283-477d-a4ab-717cc957099e service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:13.276864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9ff69-4283-477d-a4ab-717cc957099e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:13.278466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-abb9ff69-4283-477d-a4ab-717cc957099e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:13.365295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9ff69-4283-477d-a4ab-717cc957099e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:03:13.366898 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9ff69-4283-477d-a4ab-717cc957099e service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:03:13.384690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 753/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:03:15.527260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce67e4-106b-4c0f-9aa3-9b723e87d097 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:15.527839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce67e4-106b-4c0f-9aa3-9b723e87d097 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:15.527839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce67e4-106b-4c0f-9aa3-9b723e87d097 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:15.529161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 729/1482] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:03:15.534274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697095c-8bc2-44d2-a51b-17db4eb89798 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:15.534749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697095c-8bc2-44d2-a51b-17db4eb89798 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:15.534865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697095c-8bc2-44d2-a51b-17db4eb89798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:15.599354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9697095c-8bc2-44d2-a51b-17db4eb89798 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:03:15.600559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9697095c-8bc2-44d2-a51b-17db4eb89798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:15.646089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:15.696716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 754/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:03:15.731927 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce67e4-106b-4c0f-9aa3-9b723e87d097 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:03:15.733938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b5ce67e4-106b-4c0f-9aa3-9b723e87d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:15.757521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:15.835105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce67e4-106b-4c0f-9aa3-9b723e87d097 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:03:15.906779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc41f5-de08-4a6d-afe7-28c0fc1b55af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:03:15.907385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc41f5-de08-4a6d-afe7-28c0fc1b55af service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:15.907656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc41f5-de08-4a6d-afe7-28c0fc1b55af service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:15.907923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc41f5-de08-4a6d-afe7-28c0fc1b55af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:15.909506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1cbc41f5-de08-4a6d-afe7-28c0fc1b55af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:15.986214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:16.021095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc41f5-de08-4a6d-afe7-28c0fc1b55af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:03:16.022557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc41f5-de08-4a6d-afe7-28c0fc1b55af service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:03:16.041249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 730/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:03:18.090845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb680504-d9a8-40d9-92f9-590ed5a91ad2 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:18.091232 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb680504-d9a8-40d9-92f9-590ed5a91ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:18.091424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb680504-d9a8-40d9-92f9-590ed5a91ad2 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:18.093417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 755/1485] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:03:18.098638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b0fc2-c73a-4827-bea7-6f9db0224de5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:18.099061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b0fc2-c73a-4827-bea7-6f9db0224de5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:18.099188 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b0fc2-c73a-4827-bea7-6f9db0224de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:18.169615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5f4b0fc2-c73a-4827-bea7-6f9db0224de5 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:03:18.170816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5f4b0fc2-c73a-4827-bea7-6f9db0224de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:18.266150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 731/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:03:18.303226 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb680504-d9a8-40d9-92f9-590ed5a91ad2 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:03:18.304728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-eb680504-d9a8-40d9-92f9-590ed5a91ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:18.407002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb680504-d9a8-40d9-92f9-590ed5a91ad2 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:03:18.477657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:18.479476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60ab80-ad02-4ff0-aa1d-7d58f20563d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:03:18.480110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ab80-ad02-4ff0-aa1d-7d58f20563d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:18.480631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ab80-ad02-4ff0-aa1d-7d58f20563d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:18.481125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ab80-ad02-4ff0-aa1d-7d58f20563d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:18.483018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8a60ab80-ad02-4ff0-aa1d-7d58f20563d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:18.589876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60ab80-ad02-4ff0-aa1d-7d58f20563d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:03:18.591344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60ab80-ad02-4ff0-aa1d-7d58f20563d3 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:03:18.609675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 756/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:03:20.738234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefcb64-6f96-498e-8a46-b7a1b1829498 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:20.738862 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefcb64-6f96-498e-8a46-b7a1b1829498 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:20.738862 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefcb64-6f96-498e-8a46-b7a1b1829498 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:20.740160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 732/1488] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:03:20.745445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f52e8-9c91-4da4-aaad-75028684a3fc None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:20.745875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f52e8-9c91-4da4-aaad-75028684a3fc None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:20.746028 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f52e8-9c91-4da4-aaad-75028684a3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:20.811032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ff7f52e8-9c91-4da4-aaad-75028684a3fc None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:03:20.812265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ff7f52e8-9c91-4da4-aaad-75028684a3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:20.864581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:20.909519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 757/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:03:20.949345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefcb64-6f96-498e-8a46-b7a1b1829498 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:03:20.950870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dfefcb64-6f96-498e-8a46-b7a1b1829498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:20.986739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:21.055874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefcb64-6f96-498e-8a46-b7a1b1829498 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:03:21.130492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3425b-d866-4fd8-9685-5f9818688019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:03:21.131133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3425b-d866-4fd8-9685-5f9818688019 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:21.131397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3425b-d866-4fd8-9685-5f9818688019 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:21.131671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3425b-d866-4fd8-9685-5f9818688019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:21.133289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fff3425b-d866-4fd8-9685-5f9818688019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:21.213624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:21.242687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3425b-d866-4fd8-9685-5f9818688019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:03:21.244113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3425b-d866-4fd8-9685-5f9818688019 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:03:21.262099 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 733/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:03:23.416416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5048cc-6ee9-4f6f-92ae-5d7850d8b9f8 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:23.416977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5048cc-6ee9-4f6f-92ae-5d7850d8b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:23.416977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5048cc-6ee9-4f6f-92ae-5d7850d8b9f8 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:23.418300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 758/1491] 10.222.0.36 () {54 vars in 926 bytes} [Thu Jul 28 02:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:03:23.423978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbc1e9-f667-4322-9b73-0a264579cc91 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:23.424380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbc1e9-f667-4322-9b73-0a264579cc91 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:23.424523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbc1e9-f667-4322-9b73-0a264579cc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:23.490346 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a0cbc1e9-f667-4322-9b73-0a264579cc91 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:03:23.491579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a0cbc1e9-f667-4322-9b73-0a264579cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:23.587010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 734/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Jul 28 02:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:03:23.626338 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5048cc-6ee9-4f6f-92ae-5d7850d8b9f8 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:03:23.627868 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ed5048cc-6ee9-4f6f-92ae-5d7850d8b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:23.730245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5048cc-6ee9-4f6f-92ae-5d7850d8b9f8 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:03:23.804294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d972-4bea-4973-998c-4dd54ef1ebae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:03:23.804902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d972-4bea-4973-998c-4dd54ef1ebae service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:03:23.805176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d972-4bea-4973-998c-4dd54ef1ebae service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:03:23.805444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d972-4bea-4973-998c-4dd54ef1ebae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:03:23.807067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6419d972-4bea-4973-998c-4dd54ef1ebae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:03:23.816462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:23.916019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419d972-4bea-4973-998c-4dd54ef1ebae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:03:23.917460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419d972-4bea-4973-998c-4dd54ef1ebae service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:03:23.935419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 759/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:03:33.585221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=82 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:03:33.932795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=50 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:57.221067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596b038-5e05-40e8-ac83-8995a69cd10c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:57.221673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596b038-5e05-40e8-ac83-8995a69cd10c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:57.221673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596b038-5e05-40e8-ac83-8995a69cd10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:57.306491 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4596b038-5e05-40e8-ac83-8995a69cd10c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:04:57.308030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4596b038-5e05-40e8-ac83-8995a69cd10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:57.404971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 735/1494] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:04:57.413635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203bbcf-0392-4e44-83a3-d2983727ead4 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:57.414159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203bbcf-0392-4e44-83a3-d2983727ead4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:57.414159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203bbcf-0392-4e44-83a3-d2983727ead4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:57.491282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4203bbcf-0392-4e44-83a3-d2983727ead4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:04:57.492417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4203bbcf-0392-4e44-83a3-d2983727ead4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:57.588132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 760/1495] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:04:57.592886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596b038-5e05-40e8-ac83-8995a69cd10c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:04:57.594076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4596b038-5e05-40e8-ac83-8995a69cd10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:57.605937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596b038-5e05-40e8-ac83-8995a69cd10c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:04:57.666763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:57.700807 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:04:57.701414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:57.701687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:57.701953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:57.702664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:04:57.702962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:04:57.703956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:04:57.703956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: warnings.warn(msg) Jul 28 02:04:57.703956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: Jul 28 02:04:57.704834 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:04:57.715707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 736/1496] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:04:57.724162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203bbcf-0392-4e44-83a3-d2983727ead4 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:04:57.733828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203bbcf-0392-4e44-83a3-d2983727ead4 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:04:57.793849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:57.827481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67f79e-3c9d-4342-993a-5d6f61e62e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:04:57.828083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67f79e-3c9d-4342-993a-5d6f61e62e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:57.828358 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67f79e-3c9d-4342-993a-5d6f61e62e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:57.828628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67f79e-3c9d-4342-993a-5d6f61e62e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:57.829292 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67f79e-3c9d-4342-993a-5d6f61e62e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:04:57.831037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: WARNING py.warnings [None req-ca67f79e-3c9d-4342-993a-5d6f61e62e4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:04:57.831037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: warnings.warn(msg) Jul 28 02:04:57.831037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: Jul 28 02:04:57.832237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67f79e-3c9d-4342-993a-5d6f61e62e4d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:04:57.887476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 761/1497] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:04:57 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:04:57.891652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:04:57.893153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:57.925835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a7283-8fb5-4b49-82f0-4763c78371f1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:04:58.018177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c83bf1-96e6-4033-9894-f38d742776c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:04:58.018826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c83bf1-96e6-4033-9894-f38d742776c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:58.019103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c83bf1-96e6-4033-9894-f38d742776c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:58.019372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c83bf1-96e6-4033-9894-f38d742776c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:58.020023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c83bf1-96e6-4033-9894-f38d742776c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:04:58.021030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-d5c83bf1-96e6-4033-9894-f38d742776c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:04:58.021030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: warnings.warn(msg) Jul 28 02:04:58.021030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: Jul 28 02:04:58.022229 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c83bf1-96e6-4033-9894-f38d742776c6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:04:58.064651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 737/1498] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:04:57 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:04:58.069053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67f79e-3c9d-4342-993a-5d6f61e62e4d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:04:58.070578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ca67f79e-3c9d-4342-993a-5d6f61e62e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:58.132158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67f79e-3c9d-4342-993a-5d6f61e62e4d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:04:58.214159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:58.226212 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8ebb-d064-4226-a30b-fbe2203ffd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:04:58.226871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8ebb-d064-4226-a30b-fbe2203ffd73 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:58.227153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8ebb-d064-4226-a30b-fbe2203ffd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:58.227424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8ebb-d064-4226-a30b-fbe2203ffd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:58.228123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b8ebb-d064-4226-a30b-fbe2203ffd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:04:58.229142 dv-cinder-799871-46-smb devstack@keystone.service[80077]: WARNING py.warnings [None req-b63b8ebb-d064-4226-a30b-fbe2203ffd73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:04:58.229142 dv-cinder-799871-46-smb devstack@keystone.service[80077]: warnings.warn(msg) Jul 28 02:04:58.229142 dv-cinder-799871-46-smb devstack@keystone.service[80077]: Jul 28 02:04:58.230622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b8ebb-d064-4226-a30b-fbe2203ffd73 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:04:58.242744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 762/1499] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:04:58.246920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c83bf1-96e6-4033-9894-f38d742776c6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:04:58.248417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d5c83bf1-96e6-4033-9894-f38d742776c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:58.259728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c83bf1-96e6-4033-9894-f38d742776c6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:04:58.284370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:58.353192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6723e80-6702-45ed-b6ca-7f7edca715dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:04:58.353737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6723e80-6702-45ed-b6ca-7f7edca715dd admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:58.354016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6723e80-6702-45ed-b6ca-7f7edca715dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:58.354283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6723e80-6702-45ed-b6ca-7f7edca715dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:58.355584 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6723e80-6702-45ed-b6ca-7f7edca715dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:04:58.356583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-f6723e80-6702-45ed-b6ca-7f7edca715dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:04:58.356583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: warnings.warn(msg) Jul 28 02:04:58.356583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: Jul 28 02:04:58.357474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6723e80-6702-45ed-b6ca-7f7edca715dd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:04:58.369535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 738/1500] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:04:58.373799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8ebb-d064-4226-a30b-fbe2203ffd73 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:04:58.375367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b63b8ebb-d064-4226-a30b-fbe2203ffd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:58.409289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8ebb-d064-4226-a30b-fbe2203ffd73 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:04:58.502253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc55070-4bd2-4800-8db3-0f0fbd2e58e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:04:58.502943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55070-4bd2-4800-8db3-0f0fbd2e58e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:58.503199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55070-4bd2-4800-8db3-0f0fbd2e58e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:58.503467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55070-4bd2-4800-8db3-0f0fbd2e58e0 admin admin] PATH_INFO: `/v3/projects/be77b9bacda245478ffe3ac54aff6c7e/users/b42ecd95e0c14052a4eccb199da00742/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:58.525145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc55070-4bd2-4800-8db3-0f0fbd2e58e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be77b9bacda245478ffe3ac54aff6c7e, user_id=b42ecd95e0c14052a4eccb199da00742, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:04:58.526171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: WARNING py.warnings [None req-1dc55070-4bd2-4800-8db3-0f0fbd2e58e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:04:58.526171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: warnings.warn(msg) Jul 28 02:04:58.526171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: Jul 28 02:04:58.528775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc55070-4bd2-4800-8db3-0f0fbd2e58e0 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:04:58.557426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 763/1501] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:04:58 2022] PUT /identity/v3/projects/be77b9bacda245478ffe3ac54aff6c7e/users/b42ecd95e0c14052a4eccb199da00742/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:04:58.569937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11ab7-d5a4-4594-a9d3-65d316a1d3f7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:58.570218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11ab7-d5a4-4594-a9d3-65d316a1d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:58.570514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11ab7-d5a4-4594-a9d3-65d316a1d3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:58.626729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0ca11ab7-d5a4-4594-a9d3-65d316a1d3f7 None None] MFA Rules not processed for user `b42ecd95e0c14052a4eccb199da00742`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:04:58.627873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0ca11ab7-d5a4-4594-a9d3-65d316a1d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:58.705219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 739/1502] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:04:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:04:58.718957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713904-2930-4e52-9d2e-4ce232bbec23 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:58.719245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713904-2930-4e52-9d2e-4ce232bbec23 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:58.719546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713904-2930-4e52-9d2e-4ce232bbec23 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:58.720888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 764/1503] 10.222.0.36 () {54 vars in 964 bytes} [Thu Jul 28 02:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:04:58.725809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59bb87-f458-4a0c-a7fb-44a12f1af583 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:58.726095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59bb87-f458-4a0c-a7fb-44a12f1af583 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:58.726369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59bb87-f458-4a0c-a7fb-44a12f1af583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:58.757373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:58.801575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cd59bb87-f458-4a0c-a7fb-44a12f1af583 None None] MFA Rules not processed for user `983bd6880830419f9158b33411b57f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:04:58.802805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cd59bb87-f458-4a0c-a7fb-44a12f1af583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:58.877855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 740/1504] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Jul 28 02:04:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:04:58.885420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3713904-2930-4e52-9d2e-4ce232bbec23 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:04:58.887521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d3713904-2930-4e52-9d2e-4ce232bbec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:58.936887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:58.990974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3713904-2930-4e52-9d2e-4ce232bbec23 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:04:59.070359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51371c49-af0b-4ed4-9f57-84bdf9acb209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:04:59.071007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51371c49-af0b-4ed4-9f57-84bdf9acb209 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:59.071288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51371c49-af0b-4ed4-9f57-84bdf9acb209 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:59.071568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51371c49-af0b-4ed4-9f57-84bdf9acb209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:59.073227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-51371c49-af0b-4ed4-9f57-84bdf9acb209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:59.169870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51371c49-af0b-4ed4-9f57-84bdf9acb209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:04:59.171270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51371c49-af0b-4ed4-9f57-84bdf9acb209 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:04:59.174796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:59.190079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 765/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:04:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:04:59.235277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39d3b-d786-4fae-925c-fdb8da80e844 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:59.235571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39d3b-d786-4fae-925c-fdb8da80e844 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:59.235854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39d3b-d786-4fae-925c-fdb8da80e844 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:59.237171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 741/1506] 10.222.0.36 () {52 vars in 830 bytes} [Thu Jul 28 02:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:04:59.240801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51371c49-af0b-4ed4-9f57-84bdf9acb209 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:04:59.241998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-51371c49-af0b-4ed4-9f57-84bdf9acb209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:59.339283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51371c49-af0b-4ed4-9f57-84bdf9acb209 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:04:59.430981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:04:59.431542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:59.431820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:59.432090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] PATH_INFO: `/v3/users/b42ecd95e0c14052a4eccb199da00742` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:59.445669 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42ecd95e0c14052a4eccb199da00742)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:04:59.446730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: WARNING py.warnings [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:04:59.446730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: warnings.warn(msg) Jul 28 02:04:59.446730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: Jul 28 02:04:59.447953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:04:59.457515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:59.513398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42ecd95e0c14052a4eccb199da00742'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:04:59.513995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42ecd95e0c14052a4eccb199da00742'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:04:59.522139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42ecd95e0c14052a4eccb199da00742'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:04:59.540523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42ecd95e0c14052a4eccb199da00742'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:04:59.540955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42ecd95e0c14052a4eccb199da00742'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:04:59.558390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 766/1507] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:04:59 2022] DELETE /identity/v3/users/b42ecd95e0c14052a4eccb199da00742 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:04:59.562715 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3192ea-7a31-4b33-aeb8-0ac64612d4ed None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:59.563169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3192ea-7a31-4b33-aeb8-0ac64612d4ed None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:59.563277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3192ea-7a31-4b33-aeb8-0ac64612d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:59.622572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2c3192ea-7a31-4b33-aeb8-0ac64612d4ed None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:04:59.623801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2c3192ea-7a31-4b33-aeb8-0ac64612d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:59.698853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:59.712690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 742/1508] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:04:59.722786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:04:59.724010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:04:59.821919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e2d2-0142-4a0d-a1b3-898dba362723 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:04:59.876726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:04:59.897528 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00beaf-37f1-4139-8643-3f28de403e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:04:59.898148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00beaf-37f1-4139-8643-3f28de403e6f service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:04:59.898428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00beaf-37f1-4139-8643-3f28de403e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:04:59.898727 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00beaf-37f1-4139-8643-3f28de403e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:04:59.900333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-5c00beaf-37f1-4139-8643-3f28de403e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:05:00.010535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00beaf-37f1-4139-8643-3f28de403e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:05:00.012411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00beaf-37f1-4139-8643-3f28de403e6f service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:05:00.031542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 767/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:05:00.394697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3192ea-7a31-4b33-aeb8-0ac64612d4ed None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:05:00.395940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2c3192ea-7a31-4b33-aeb8-0ac64612d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:05:00.407643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3192ea-7a31-4b33-aeb8-0ac64612d4ed None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:05:00.503966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:05:00.504624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:05:00.504904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:05:00.505176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] PATH_INFO: `/v3/projects/be77b9bacda245478ffe3ac54aff6c7e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:05:00.515769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be77b9bacda245478ffe3ac54aff6c7e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:05:00.516790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:05:00.516790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: warnings.warn(msg) Jul 28 02:05:00.516790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: Jul 28 02:05:00.517978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:05:00.580000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be77b9bacda245478ffe3ac54aff6c7e', 'request_id': 'req-768ebc79-3451-4011-bc4e-3c0312d22056'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:05:00.585845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be77b9bacda245478ffe3ac54aff6c7e', 'request_id': 'req-768ebc79-3451-4011-bc4e-3c0312d22056'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:05:00.598820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be77b9bacda245478ffe3ac54aff6c7e', 'request_id': 'req-768ebc79-3451-4011-bc4e-3c0312d22056'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:05:00.625588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] The token cache is being invalidate because project be77b9bacda245478ffe3ac54aff6c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:05:00.625878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:05:00.626306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-768ebc79-3451-4011-bc4e-3c0312d22056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:05:00.627774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 743/1510] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:05:00 2022] DELETE /identity/v3/projects/be77b9bacda245478ffe3ac54aff6c7e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:05:10.029276 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=62 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:05:10.623587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:06:44.249128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d479ce7-897c-43bf-848b-dcc26ff11781 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:44.249594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d479ce7-897c-43bf-848b-dcc26ff11781 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:44.249695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d479ce7-897c-43bf-848b-dcc26ff11781 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:44.251088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:06:44.255837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb93581-8014-420f-920f-ddebf8e91d18 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:44.256262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb93581-8014-420f-920f-ddebf8e91d18 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:44.256372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb93581-8014-420f-920f-ddebf8e91d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:44.335672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-eeb93581-8014-420f-920f-ddebf8e91d18 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:06:44.337460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-eeb93581-8014-420f-920f-ddebf8e91d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:06:44.441724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:06:44.596574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d479ce7-897c-43bf-848b-dcc26ff11781 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:06:44.598667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9d479ce7-897c-43bf-848b-dcc26ff11781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:06:44.717374 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d479ce7-897c-43bf-848b-dcc26ff11781 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:06:44.722890 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa59610-2bee-4b1b-afeb-fe1a3e9b2fe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:06:44.723501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa59610-2bee-4b1b-afeb-fe1a3e9b2fe7 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:44.723783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa59610-2bee-4b1b-afeb-fe1a3e9b2fe7 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:44.724055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa59610-2bee-4b1b-afeb-fe1a3e9b2fe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:44.732341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa59610-2bee-4b1b-afeb-fe1a3e9b2fe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:06:44.733924 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa59610-2bee-4b1b-afeb-fe1a3e9b2fe7 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:06:44.743973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 769/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:06:45.568273 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280df33-a9ac-49db-9f5b-55ae9d7da5a3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:45.568867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280df33-a9ac-49db-9f5b-55ae9d7da5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:45.568867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280df33-a9ac-49db-9f5b-55ae9d7da5a3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:45.570225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 745/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:06:45.575461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb95a28-704a-47ec-a18b-c8c8ee3b4988 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:45.575880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb95a28-704a-47ec-a18b-c8c8ee3b4988 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:45.576016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb95a28-704a-47ec-a18b-c8c8ee3b4988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:45.595699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-dfb95a28-704a-47ec-a18b-c8c8ee3b4988 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:06:45.596894 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-dfb95a28-704a-47ec-a18b-c8c8ee3b4988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:06:45.604805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 770/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:06:45.754979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280df33-a9ac-49db-9f5b-55ae9d7da5a3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:06:45.769674 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280df33-a9ac-49db-9f5b-55ae9d7da5a3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:06:45.775752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb1cbe-7852-4483-9d51-b23e3efd0337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:06:45.776353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb1cbe-7852-4483-9d51-b23e3efd0337 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:45.776633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb1cbe-7852-4483-9d51-b23e3efd0337 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:45.776906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb1cbe-7852-4483-9d51-b23e3efd0337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:45.784860 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb1cbe-7852-4483-9d51-b23e3efd0337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:06:45.786431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb1cbe-7852-4483-9d51-b23e3efd0337 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:06:45.795892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 746/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:06:45.917982 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7256e-bfb3-46c6-ac3f-5655ba73c21f None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:45.918333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7256e-bfb3-46c6-ac3f-5655ba73c21f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:45.918684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7256e-bfb3-46c6-ac3f-5655ba73c21f None None] PATH_INFO: `/v3` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:45.920025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 771/1517] 10.222.0.46 () {54 vars in 925 bytes} [Thu Jul 28 02:06:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:06:45.927025 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a2faf-9e04-452a-a55b-82117f883b8e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:45.927307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a2faf-9e04-452a-a55b-82117f883b8e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:45.927581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a2faf-9e04-452a-a55b-82117f883b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:45.986494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6f6a2faf-9e04-452a-a55b-82117f883b8e None None] MFA Rules not processed for user `e041d38c69cd4626898bc1412f5ed1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:06:45.987693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6f6a2faf-9e04-452a-a55b-82117f883b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:06:46.004497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:06:46.059035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 747/1518] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Jul 28 02:06:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:06:55.145028 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f1272-f00d-4ffd-8a8d-a776daefc13b None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:55.145577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f1272-f00d-4ffd-8a8d-a776daefc13b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:55.145577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f1272-f00d-4ffd-8a8d-a776daefc13b None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:55.146870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 772/1519] 10.222.0.36 () {54 vars in 961 bytes} [Thu Jul 28 02:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:06:55.152470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae6d85-e2e0-4d32-9c32-e455bde9195a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:55.152951 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae6d85-e2e0-4d32-9c32-e455bde9195a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:55.153059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae6d85-e2e0-4d32-9c32-e455bde9195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:55.172585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-09ae6d85-e2e0-4d32-9c32-e455bde9195a None None] MFA Rules not processed for user `e041d38c69cd4626898bc1412f5ed1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:06:55.173767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-09ae6d85-e2e0-4d32-9c32-e455bde9195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:06:55.182062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 748/1520] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Jul 28 02:06:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:06:55.189250 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f1272-f00d-4ffd-8a8d-a776daefc13b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:06:55.202776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f1272-f00d-4ffd-8a8d-a776daefc13b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:06:55.207694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b37f0-967b-448f-a559-17a2db84f030 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:06:55.208285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b37f0-967b-448f-a559-17a2db84f030 service placement] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:55.208564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b37f0-967b-448f-a559-17a2db84f030 service placement] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:55.208834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b37f0-967b-448f-a559-17a2db84f030 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:55.217477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b37f0-967b-448f-a559-17a2db84f030 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:06:55.219133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b37f0-967b-448f-a559-17a2db84f030 service placement] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:06:55.229277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 773/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:06:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:06:57.008900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2226d6-ae3d-470a-875c-3a1f38097c76 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:57.009457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2226d6-ae3d-470a-875c-3a1f38097c76 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:57.009457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2226d6-ae3d-470a-875c-3a1f38097c76 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:57.010847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:06:57.015851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873077-a4e4-4ee8-a32d-554a2a4e1a07 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:57.016270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873077-a4e4-4ee8-a32d-554a2a4e1a07 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:57.016458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873077-a4e4-4ee8-a32d-554a2a4e1a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:57.035134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-89873077-a4e4-4ee8-a32d-554a2a4e1a07 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:06:57.036309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-89873077-a4e4-4ee8-a32d-554a2a4e1a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:06:57.044536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:06:57.196353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2226d6-ae3d-470a-875c-3a1f38097c76 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:06:57.210533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2226d6-ae3d-470a-875c-3a1f38097c76 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:06:57.216608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e4fff-2bad-4f42-9e3a-1fdb3da5723b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:06:57.217259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e4fff-2bad-4f42-9e3a-1fdb3da5723b service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:57.217539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e4fff-2bad-4f42-9e3a-1fdb3da5723b service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:57.217921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e4fff-2bad-4f42-9e3a-1fdb3da5723b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:57.226183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e4fff-2bad-4f42-9e3a-1fdb3da5723b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:06:57.228449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e4fff-2bad-4f42-9e3a-1fdb3da5723b service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:06:57.237731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 750/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:06:58.053302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9236b9-aec0-421e-9f15-ddc9d168fea8 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:58.053882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9236b9-aec0-421e-9f15-ddc9d168fea8 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:58.053882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9236b9-aec0-421e-9f15-ddc9d168fea8 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:58.055847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 02:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:06:58.060544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be074-900b-488a-b01a-d98486e2887d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:58.060946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be074-900b-488a-b01a-d98486e2887d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:58.061104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be074-900b-488a-b01a-d98486e2887d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:58.080845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d06be074-900b-488a-b01a-d98486e2887d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:06:58.082042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d06be074-900b-488a-b01a-d98486e2887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:06:58.089797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 02:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:06:58.240915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9236b9-aec0-421e-9f15-ddc9d168fea8 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:06:58.255785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9236b9-aec0-421e-9f15-ddc9d168fea8 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:06:58.261877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaf2df-62a0-4ffa-8f2b-895bc0f5e5fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:06:58.262496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaf2df-62a0-4ffa-8f2b-895bc0f5e5fb service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:06:58.262782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaf2df-62a0-4ffa-8f2b-895bc0f5e5fb service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:06:58.263055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaf2df-62a0-4ffa-8f2b-895bc0f5e5fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:06:58.271068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceaf2df-62a0-4ffa-8f2b-895bc0f5e5fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:06:58.272651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceaf2df-62a0-4ffa-8f2b-895bc0f5e5fb service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:06:58.281944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 776/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:07:01.986628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cbdfa-a2ec-4258-8c8a-adf3c0033351 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:01.987396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cbdfa-a2ec-4258-8c8a-adf3c0033351 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:01.987396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cbdfa-a2ec-4258-8c8a-adf3c0033351 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:01.988540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:07:01.994336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59713-10a2-41e3-b184-77e53480cd3f None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:01.997071 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59713-10a2-41e3-b184-77e53480cd3f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:01.997071 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59713-10a2-41e3-b184-77e53480cd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:02.013816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-95e59713-10a2-41e3-b184-77e53480cd3f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:07:02.015048 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-95e59713-10a2-41e3-b184-77e53480cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:07:02.022854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:07:02.095342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cbdfa-a2ec-4258-8c8a-adf3c0033351 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:07:02.097087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3f0cbdfa-a2ec-4258-8c8a-adf3c0033351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:07:02.173163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cbdfa-a2ec-4258-8c8a-adf3c0033351 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:07:02.176727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fe251-d2f5-47d9-9528-c560899e08cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:07:02.177340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe251-d2f5-47d9-9528-c560899e08cd service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:02.177621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe251-d2f5-47d9-9528-c560899e08cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:02.177896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe251-d2f5-47d9-9528-c560899e08cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:02.187013 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fe251-d2f5-47d9-9528-c560899e08cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:07:02.188443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fe251-d2f5-47d9-9528-c560899e08cd service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:07:02.198519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 753/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:07:04.165068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea277f-8821-4e4a-941e-b29f0f849193 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:04.165639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea277f-8821-4e4a-941e-b29f0f849193 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:04.165639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea277f-8821-4e4a-941e-b29f0f849193 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:04.167559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:07:04.172842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166100e5-4cb3-4876-be72-db8544a4ec11 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:04.173257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166100e5-4cb3-4876-be72-db8544a4ec11 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:04.173391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166100e5-4cb3-4876-be72-db8544a4ec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:04.192833 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-166100e5-4cb3-4876-be72-db8544a4ec11 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:07:04.194029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-166100e5-4cb3-4876-be72-db8544a4ec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:07:04.201756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:07:04.237797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea277f-8821-4e4a-941e-b29f0f849193 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:07:04.248508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea277f-8821-4e4a-941e-b29f0f849193 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:07:04.252011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780a77b-1d00-46bb-857b-5fc9b2c62228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:07:04.252638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a77b-1d00-46bb-857b-5fc9b2c62228 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:04.252919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a77b-1d00-46bb-857b-5fc9b2c62228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:04.253196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a77b-1d00-46bb-857b-5fc9b2c62228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:04.261956 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780a77b-1d00-46bb-857b-5fc9b2c62228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:07:04.263417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780a77b-1d00-46bb-857b-5fc9b2c62228 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:07:04.272690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 779/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:07:07.674021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287ca1c-9165-4f15-ae86-335d434e8951 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:07.674628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287ca1c-9165-4f15-ae86-335d434e8951 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:07.674628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287ca1c-9165-4f15-ae86-335d434e8951 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:07.675974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:07:07.680976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf00c0-4296-41ed-897a-6057ff43e01e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:07.681419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf00c0-4296-41ed-897a-6057ff43e01e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:07.681559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf00c0-4296-41ed-897a-6057ff43e01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:07.701818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-cbdf00c0-4296-41ed-897a-6057ff43e01e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:07:07.703042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-cbdf00c0-4296-41ed-897a-6057ff43e01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:07:07.710773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:07:08.017339 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287ca1c-9165-4f15-ae86-335d434e8951 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:07:08.019360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9287ca1c-9165-4f15-ae86-335d434e8951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:07:08.085659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:07:08.099012 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287ca1c-9165-4f15-ae86-335d434e8951 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:07:08.102628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5659b3d-1b6f-481d-a996-759d3afc09c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:07:08.103236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5659b3d-1b6f-481d-a996-759d3afc09c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:08.103514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5659b3d-1b6f-481d-a996-759d3afc09c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:08.103787 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5659b3d-1b6f-481d-a996-759d3afc09c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:08.113124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5659b3d-1b6f-481d-a996-759d3afc09c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:07:08.114605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5659b3d-1b6f-481d-a996-759d3afc09c1 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:07:08.124815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 756/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:07:10.135293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf42401-b331-4d3b-972a-a563f670872a None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:10.135830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf42401-b331-4d3b-972a-a563f670872a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:10.135830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf42401-b331-4d3b-972a-a563f670872a None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:10.137119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 02:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:07:10.142396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31c04-4317-4d41-be92-16558ab317a0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:10.142844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31c04-4317-4d41-be92-16558ab317a0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:10.143032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31c04-4317-4d41-be92-16558ab317a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:10.162374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ffe31c04-4317-4d41-be92-16558ab317a0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:07:10.163590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ffe31c04-4317-4d41-be92-16558ab317a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:07:10.171868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 02:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:07:10.479440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf42401-b331-4d3b-972a-a563f670872a None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:07:10.481117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ebf42401-b331-4d3b-972a-a563f670872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:07:10.488601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=84 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:07:10.495408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf42401-b331-4d3b-972a-a563f670872a None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:07:10.498824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6a46b-9cbe-4be5-900e-2abdad69efa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:07:10.499418 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6a46b-9cbe-4be5-900e-2abdad69efa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:07:10.499710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6a46b-9cbe-4be5-900e-2abdad69efa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:07:10.499979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6a46b-9cbe-4be5-900e-2abdad69efa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:07:10.508594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6a46b-9cbe-4be5-900e-2abdad69efa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:07:10.510011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6a46b-9cbe-4be5-900e-2abdad69efa6 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:07:10.519918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 782/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:07:20.157381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=11 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:07:20.515588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:45.461337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7b973-54d3-471c-8a45-26267f5980e3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.462901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7b973-54d3-471c-8a45-26267f5980e3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.463352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7b973-54d3-471c-8a45-26267f5980e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.485574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-37a7b973-54d3-471c-8a45-26267f5980e3 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:45.486045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b332261-aa67-420c-ad06-2c61bf216d82 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.487067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b332261-aa67-420c-ad06-2c61bf216d82 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.487605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b332261-aa67-420c-ad06-2c61bf216d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.494058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-37a7b973-54d3-471c-8a45-26267f5980e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:45.502829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 758/1540] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:45.516904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-0b332261-aa67-420c-ad06-2c61bf216d82 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:45.518123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0b332261-aa67-420c-ad06-2c61bf216d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:45.525217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cbe61-75ad-42b0-8cec-c0fe270b30d8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.525506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cbe61-75ad-42b0-8cec-c0fe270b30d8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.525868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cbe61-75ad-42b0-8cec-c0fe270b30d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.530706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 783/1541] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:08:45.540123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334b108-8cf8-493b-8651-79b568ef898e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.540415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334b108-8cf8-493b-8651-79b568ef898e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.540685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334b108-8cf8-493b-8651-79b568ef898e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.567801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cc6cbe61-75ad-42b0-8cec-c0fe270b30d8 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:45.575853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cc6cbe61-75ad-42b0-8cec-c0fe270b30d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:45.579057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-1334b108-8cf8-493b-8651-79b568ef898e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:45.580254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-1334b108-8cf8-493b-8651-79b568ef898e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:45.592647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 784/1542] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:08:45.593893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d036d-a16e-4bed-8fe5-54b39d6fb591 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.594182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d036d-a16e-4bed-8fe5-54b39d6fb591 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.594471 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d036d-a16e-4bed-8fe5-54b39d6fb591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.598145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 759/1543] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 28 02:08:45.599035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cbe61-75ad-42b0-8cec-c0fe270b30d8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:45.614250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cbe61-75ad-42b0-8cec-c0fe270b30d8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:45.628478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-7a9d036d-a16e-4bed-8fe5-54b39d6fb591 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:45.629683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7a9d036d-a16e-4bed-8fe5-54b39d6fb591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:45.631129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80338e-4942-4c6f-a0a1-27d69a51cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:45.631805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80338e-4942-4c6f-a0a1-27d69a51cb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.632029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80338e-4942-4c6f-a0a1-27d69a51cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.632306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80338e-4942-4c6f-a0a1-27d69a51cb03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.633011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80338e-4942-4c6f-a0a1-27d69a51cb03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:08:45.633318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80338e-4942-4c6f-a0a1-27d69a51cb03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:45.635531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80338e-4942-4c6f-a0a1-27d69a51cb03 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:45.647965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 785/1544] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:45.648594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d036d-a16e-4bed-8fe5-54b39d6fb591 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:45.654539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 760/1545] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:08:45.667593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80338e-4942-4c6f-a0a1-27d69a51cb03 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:45.669156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d036d-a16e-4bed-8fe5-54b39d6fb591 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:45.678273 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eecb7a-f0e5-464a-a24e-eaea577e9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:45.679065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eecb7a-f0e5-464a-a24e-eaea577e9e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.679358 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eecb7a-f0e5-464a-a24e-eaea577e9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.679632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eecb7a-f0e5-464a-a24e-eaea577e9e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.680347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eecb7a-f0e5-464a-a24e-eaea577e9e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:08:45.680700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eecb7a-f0e5-464a-a24e-eaea577e9e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:45.681732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: WARNING py.warnings [None req-54eecb7a-f0e5-464a-a24e-eaea577e9e07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:08:45.681732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: warnings.warn(msg) Jul 28 02:08:45.681732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: Jul 28 02:08:45.682226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80338e-4942-4c6f-a0a1-27d69a51cb03 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:45.682649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eecb7a-f0e5-464a-a24e-eaea577e9e07 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:45.698148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 786/1546] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:08:45.699963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e94f64-8709-44ad-be86-0481298abdee None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.700260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e94f64-8709-44ad-be86-0481298abdee None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.700529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e94f64-8709-44ad-be86-0481298abdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.703790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10638b0-da9e-4f4a-a0b0-7fc65a22c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:45.704422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10638b0-da9e-4f4a-a0b0-7fc65a22c963 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.704705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10638b0-da9e-4f4a-a0b0-7fc65a22c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.704979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10638b0-da9e-4f4a-a0b0-7fc65a22c963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.705644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10638b0-da9e-4f4a-a0b0-7fc65a22c963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:45.706859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-c10638b0-da9e-4f4a-a0b0-7fc65a22c963 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:08:45.706859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: warnings.warn(msg) Jul 28 02:08:45.706859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: Jul 28 02:08:45.708051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10638b0-da9e-4f4a-a0b0-7fc65a22c963 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:45.738861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-77e94f64-8709-44ad-be86-0481298abdee None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:45.740016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-77e94f64-8709-44ad-be86-0481298abdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:45.767686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 787/1547] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:45.769961 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e26c0-fe9a-4b46-b8a3-f040648e1edf None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.770250 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e26c0-fe9a-4b46-b8a3-f040648e1edf None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.770557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e26c0-fe9a-4b46-b8a3-f040648e1edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.780705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 761/1548] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:45.781646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10638b0-da9e-4f4a-a0b0-7fc65a22c963 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:45.805241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9f5e26c0-fe9a-4b46-b8a3-f040648e1edf None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:45.807089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9f5e26c0-fe9a-4b46-b8a3-f040648e1edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:45.869159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10638b0-da9e-4f4a-a0b0-7fc65a22c963 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:45.877281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3c9d8-c179-4c2b-8ab5-a6e9cfdc9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:45.886029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c9d8-c179-4c2b-8ab5-a6e9cfdc9f39 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.886191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 788/1549] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:45.886312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c9d8-c179-4c2b-8ab5-a6e9cfdc9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.886312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c9d8-c179-4c2b-8ab5-a6e9cfdc9f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.886517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e26c0-fe9a-4b46-b8a3-f040648e1edf None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:45.886633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3c9d8-c179-4c2b-8ab5-a6e9cfdc9f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:45.886633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3c9d8-c179-4c2b-8ab5-a6e9cfdc9f39 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:45.891016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e26c0-fe9a-4b46-b8a3-f040648e1edf None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:45.896253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250a495-ca07-4137-896c-717bad34fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:45.896864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250a495-ca07-4137-896c-717bad34fafd admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.897135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250a495-ca07-4137-896c-717bad34fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.897576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250a495-ca07-4137-896c-717bad34fafd admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.898281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250a495-ca07-4137-896c-717bad34fafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:08:45.898684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250a495-ca07-4137-896c-717bad34fafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:45.900679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250a495-ca07-4137-896c-717bad34fafd admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:45.909800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 762/1550] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:45.911169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f99c0-5ab8-461e-aadb-6d9b3cd66846 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.911524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f99c0-5ab8-461e-aadb-6d9b3cd66846 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.911811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f99c0-5ab8-461e-aadb-6d9b3cd66846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.913924 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 789/1551] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:08:45.914747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250a495-ca07-4137-896c-717bad34fafd admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:45.924482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250a495-ca07-4137-896c-717bad34fafd admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:45.932194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-740f99c0-5ab8-461e-aadb-6d9b3cd66846 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:45.933397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-740f99c0-5ab8-461e-aadb-6d9b3cd66846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:45.981816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c210e-4adc-4178-a57b-778491d2f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:45.982432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c210e-4adc-4178-a57b-778491d2f6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.982741 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c210e-4adc-4178-a57b-778491d2f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.983016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c210e-4adc-4178-a57b-778491d2f6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:45.983679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c210e-4adc-4178-a57b-778491d2f6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:45.984749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: WARNING py.warnings [None req-4c2c210e-4adc-4178-a57b-778491d2f6d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:08:45.984749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: warnings.warn(msg) Jul 28 02:08:45.984749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: Jul 28 02:08:45.985956 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c210e-4adc-4178-a57b-778491d2f6d8 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:45.992498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 763/1552] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:45.994786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bf15-d564-40e7-af38-f5f6f858ae69 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:45.995683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bf15-d564-40e7-af38-f5f6f858ae69 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:45.996558 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bf15-d564-40e7-af38-f5f6f858ae69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.012536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 790/1553] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.012536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53740197-981f-4a2d-aa75-d9ee1de34fbc None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.012536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53740197-981f-4a2d-aa75-d9ee1de34fbc None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.012536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53740197-981f-4a2d-aa75-d9ee1de34fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.019172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4ab8bf15-d564-40e7-af38-f5f6f858ae69 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:46.020370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4ab8bf15-d564-40e7-af38-f5f6f858ae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:46.028312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 764/1554] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:46.029541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de423f79-87e1-4b4a-aaae-0ac20e7b7971 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.029825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de423f79-87e1-4b4a-aaae-0ac20e7b7971 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.030097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de423f79-87e1-4b4a-aaae-0ac20e7b7971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.030285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-53740197-981f-4a2d-aa75-d9ee1de34fbc None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:46.031448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-53740197-981f-4a2d-aa75-d9ee1de34fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:46.039506 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 791/1555] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:46.041316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c140c2-ff8b-4b19-8d5c-62836535d5a4 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.041706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c140c2-ff8b-4b19-8d5c-62836535d5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.042087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c140c2-ff8b-4b19-8d5c-62836535d5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.049507 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-de423f79-87e1-4b4a-aaae-0ac20e7b7971 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:46.050723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-de423f79-87e1-4b4a-aaae-0ac20e7b7971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:46.060059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 765/1556] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:46.060900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de423f79-87e1-4b4a-aaae-0ac20e7b7971 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.062068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-b2c140c2-ff8b-4b19-8d5c-62836535d5a4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:46.063294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b2c140c2-ff8b-4b19-8d5c-62836535d5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:46.072240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de423f79-87e1-4b4a-aaae-0ac20e7b7971 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.073536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 792/1557] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:46.074337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c140c2-ff8b-4b19-8d5c-62836535d5a4 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.080453 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba2428-1d72-4ee1-8a66-3a261ca2ba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.081068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba2428-1d72-4ee1-8a66-3a261ca2ba3b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.081349 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba2428-1d72-4ee1-8a66-3a261ca2ba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.081625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba2428-1d72-4ee1-8a66-3a261ca2ba3b admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.082285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba2428-1d72-4ee1-8a66-3a261ca2ba3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.083798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c140c2-ff8b-4b19-8d5c-62836535d5a4 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.084287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba2428-1d72-4ee1-8a66-3a261ca2ba3b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.088378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ee8f8-f14e-400d-bd34-619804005c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.088960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee8f8-f14e-400d-bd34-619804005c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.089241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee8f8-f14e-400d-bd34-619804005c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.089512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee8f8-f14e-400d-bd34-619804005c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.090162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ee8f8-f14e-400d-bd34-619804005c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.092093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ee8f8-f14e-400d-bd34-619804005c07 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.100839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:46.107613 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 766/1558] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.109499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238db51a-6625-42ef-9770-e2dba7a2251e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.109785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238db51a-6625-42ef-9770-e2dba7a2251e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.110058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238db51a-6625-42ef-9770-e2dba7a2251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.123767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 793/1559] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.124875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ee8f8-f14e-400d-bd34-619804005c07 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.129637 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:46.132663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-238db51a-6625-42ef-9770-e2dba7a2251e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:46.134624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-238db51a-6625-42ef-9770-e2dba7a2251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:46.188277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ee8f8-f14e-400d-bd34-619804005c07 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.193284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea9b21-b96f-4ba7-b8b8-275abee70ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.193913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9b21-b96f-4ba7-b8b8-275abee70ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.194226 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9b21-b96f-4ba7-b8b8-275abee70ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.194522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9b21-b96f-4ba7-b8b8-275abee70ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.195408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea9b21-b96f-4ba7-b8b8-275abee70ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.197690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea9b21-b96f-4ba7-b8b8-275abee70ee7 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.198593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 767/1560] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:46.200052 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97e0b2-dba2-41dd-aab3-d21753147406 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.200339 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97e0b2-dba2-41dd-aab3-d21753147406 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.200619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97e0b2-dba2-41dd-aab3-d21753147406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.211381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 794/1561] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:46.211381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a320-9766-42f9-aae1-b1ac719eaf64 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.211381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a320-9766-42f9-aae1-b1ac719eaf64 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.211381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a320-9766-42f9-aae1-b1ac719eaf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.219531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1f97e0b2-dba2-41dd-aab3-d21753147406 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:46.220732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1f97e0b2-dba2-41dd-aab3-d21753147406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:46.229148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 768/1562] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:46.230324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce4ffd-f4c6-437c-91a8-ba973f08ce17 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.230475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f581a320-9766-42f9-aae1-b1ac719eaf64 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:46.230678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce4ffd-f4c6-437c-91a8-ba973f08ce17 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.230923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce4ffd-f4c6-437c-91a8-ba973f08ce17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.231568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f581a320-9766-42f9-aae1-b1ac719eaf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:46.239518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 795/1563] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:46.240300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a320-9766-42f9-aae1-b1ac719eaf64 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.250028 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a320-9766-42f9-aae1-b1ac719eaf64 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.250342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-05ce4ffd-f4c6-437c-91a8-ba973f08ce17 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:46.251561 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-05ce4ffd-f4c6-437c-91a8-ba973f08ce17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:46.254557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e644a7-66dd-4b10-aea7-ea9a2f407475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.255156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e644a7-66dd-4b10-aea7-ea9a2f407475 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.255437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e644a7-66dd-4b10-aea7-ea9a2f407475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.255707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e644a7-66dd-4b10-aea7-ea9a2f407475 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.256400 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e644a7-66dd-4b10-aea7-ea9a2f407475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:08:46.256700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e644a7-66dd-4b10-aea7-ea9a2f407475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.258296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e644a7-66dd-4b10-aea7-ea9a2f407475 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.261016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 769/1564] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:46.262126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce4ffd-f4c6-437c-91a8-ba973f08ce17 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.276536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 796/1565] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:08:46.276536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e644a7-66dd-4b10-aea7-ea9a2f407475 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.277406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce4ffd-f4c6-437c-91a8-ba973f08ce17 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.281737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58175f5-5d1c-48b2-8b7b-f399396a6abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.282077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e644a7-66dd-4b10-aea7-ea9a2f407475 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.282351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58175f5-5d1c-48b2-8b7b-f399396a6abe admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.282661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58175f5-5d1c-48b2-8b7b-f399396a6abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.282937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58175f5-5d1c-48b2-8b7b-f399396a6abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.283639 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58175f5-5d1c-48b2-8b7b-f399396a6abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.285252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58175f5-5d1c-48b2-8b7b-f399396a6abe admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.287160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00dd39-144c-42bc-a0b8-3801b795611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.287860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00dd39-144c-42bc-a0b8-3801b795611c admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.288145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00dd39-144c-42bc-a0b8-3801b795611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.288470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00dd39-144c-42bc-a0b8-3801b795611c admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.289124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00dd39-144c-42bc-a0b8-3801b795611c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.291619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00dd39-144c-42bc-a0b8-3801b795611c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.295943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 770/1566] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:46.296732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58175f5-5d1c-48b2-8b7b-f399396a6abe admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.309288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58175f5-5d1c-48b2-8b7b-f399396a6abe admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.314166 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eaae8-c789-4f4a-a5aa-21e480bdd616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.315061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eaae8-c789-4f4a-a5aa-21e480bdd616 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.315344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eaae8-c789-4f4a-a5aa-21e480bdd616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.315618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eaae8-c789-4f4a-a5aa-21e480bdd616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.315711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 797/1567] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.316313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950eaae8-c789-4f4a-a5aa-21e480bdd616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:08:46.316467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00dd39-144c-42bc-a0b8-3801b795611c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.316608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950eaae8-c789-4f4a-a5aa-21e480bdd616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.318195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950eaae8-c789-4f4a-a5aa-21e480bdd616 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.327958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00dd39-144c-42bc-a0b8-3801b795611c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.331623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 771/1568] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:08:46.332548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eaae8-c789-4f4a-a5aa-21e480bdd616 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.337712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb399a-0af9-415b-ac6a-38268c6a0088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.338316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb399a-0af9-415b-ac6a-38268c6a0088 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.338677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb399a-0af9-415b-ac6a-38268c6a0088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.338949 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb399a-0af9-415b-ac6a-38268c6a0088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.339646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb399a-0af9-415b-ac6a-38268c6a0088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.341281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb399a-0af9-415b-ac6a-38268c6a0088 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.346875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eaae8-c789-4f4a-a5aa-21e480bdd616 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.351268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 798/1569] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:46.351477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000b189-9587-4a44-9001-128515e41b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.352058 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb399a-0af9-415b-ac6a-38268c6a0088 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.352183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000b189-9587-4a44-9001-128515e41b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.352925 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000b189-9587-4a44-9001-128515e41b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.353142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000b189-9587-4a44-9001-128515e41b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.353821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000b189-9587-4a44-9001-128515e41b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:08:46.354118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000b189-9587-4a44-9001-128515e41b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.356112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000b189-9587-4a44-9001-128515e41b6a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.363626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb399a-0af9-415b-ac6a-38268c6a0088 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.375041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 772/1570] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:08:46.375201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b897ef-7cf3-48b4-9eff-ba0535c2351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.375337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000b189-9587-4a44-9001-128515e41b6a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.375451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b897ef-7cf3-48b4-9eff-ba0535c2351e admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.375451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b897ef-7cf3-48b4-9eff-ba0535c2351e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.375451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b897ef-7cf3-48b4-9eff-ba0535c2351e admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.375451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b897ef-7cf3-48b4-9eff-ba0535c2351e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:08:46.375451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b897ef-7cf3-48b4-9eff-ba0535c2351e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.375451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b897ef-7cf3-48b4-9eff-ba0535c2351e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.379067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000b189-9587-4a44-9001-128515e41b6a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.384294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0658290-6f30-42bb-8933-b4a9e623ee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.384883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0658290-6f30-42bb-8933-b4a9e623ee05 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.385163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0658290-6f30-42bb-8933-b4a9e623ee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.385437 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0658290-6f30-42bb-8933-b4a9e623ee05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.386119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0658290-6f30-42bb-8933-b4a9e623ee05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:08:46.393383 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0658290-6f30-42bb-8933-b4a9e623ee05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.393533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 799/1571] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:08:46.393533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b897ef-7cf3-48b4-9eff-ba0535c2351e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.393753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0658290-6f30-42bb-8933-b4a9e623ee05 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.407060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 773/1572] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:08:46.407060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0658290-6f30-42bb-8933-b4a9e623ee05 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.407330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b897ef-7cf3-48b4-9eff-ba0535c2351e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.408240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e9d0d-2639-4135-9aa2-9a9c18989c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.408841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9d0d-2639-4135-9aa2-9a9c18989c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.409119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9d0d-2639-4135-9aa2-9a9c18989c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.409389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9d0d-2639-4135-9aa2-9a9c18989c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.410036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e9d0d-2639-4135-9aa2-9a9c18989c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.411959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e9d0d-2639-4135-9aa2-9a9c18989c05 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.412305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0658290-6f30-42bb-8933-b4a9e623ee05 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.417396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cd98d-1cfb-4764-b55b-0bbb8968f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.418000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cd98d-1cfb-4764-b55b-0bbb8968f717 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.418265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cd98d-1cfb-4764-b55b-0bbb8968f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.418570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cd98d-1cfb-4764-b55b-0bbb8968f717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.419252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cd98d-1cfb-4764-b55b-0bbb8968f717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.420801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cd98d-1cfb-4764-b55b-0bbb8968f717 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.431308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 774/1573] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:46.432104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cd98d-1cfb-4764-b55b-0bbb8968f717 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.441484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 800/1574] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.441969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cd98d-1cfb-4764-b55b-0bbb8968f717 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.442699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e9d0d-2639-4135-9aa2-9a9c18989c05 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.499430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af489c40-9835-43cc-b90d-23ac6e5f0ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.500310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af489c40-9835-43cc-b90d-23ac6e5f0ece admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.500543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af489c40-9835-43cc-b90d-23ac6e5f0ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.500828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af489c40-9835-43cc-b90d-23ac6e5f0ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.501552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af489c40-9835-43cc-b90d-23ac6e5f0ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.503201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af489c40-9835-43cc-b90d-23ac6e5f0ece admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.504450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e9d0d-2639-4135-9aa2-9a9c18989c05 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.509091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23866012-287a-4679-acbf-9a1ac8948c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.509697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23866012-287a-4679-acbf-9a1ac8948c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.510057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23866012-287a-4679-acbf-9a1ac8948c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.510249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23866012-287a-4679-acbf-9a1ac8948c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.510939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23866012-287a-4679-acbf-9a1ac8948c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.513003 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23866012-287a-4679-acbf-9a1ac8948c7a admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.513275 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 775/1575] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:46.514126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af489c40-9835-43cc-b90d-23ac6e5f0ece admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.524233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af489c40-9835-43cc-b90d-23ac6e5f0ece admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.529005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30399f25-5063-4723-acc4-1b256e25bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.529804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30399f25-5063-4723-acc4-1b256e25bccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.530140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30399f25-5063-4723-acc4-1b256e25bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.530477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30399f25-5063-4723-acc4-1b256e25bccd admin admin] PATH_INFO: `/v3/projects/7c911b0d2d654cff8df77a5483ad08bf/users/80ab8a36909341869be8db4c103c4059/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.535651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:46.543893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 801/1576] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.544992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23866012-287a-4679-acbf-9a1ac8948c7a admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.547053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30399f25-5063-4723-acc4-1b256e25bccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c911b0d2d654cff8df77a5483ad08bf, user_id=80ab8a36909341869be8db4c103c4059, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.548129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-30399f25-5063-4723-acc4-1b256e25bccd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:08:46.548129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: warnings.warn(msg) Jul 28 02:08:46.548129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: Jul 28 02:08:46.550109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30399f25-5063-4723-acc4-1b256e25bccd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.555112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:46.570850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 776/1577] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:46 2022] PUT /identity/v3/projects/7c911b0d2d654cff8df77a5483ad08bf/users/80ab8a36909341869be8db4c103c4059/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:46.570850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30399f25-5063-4723-acc4-1b256e25bccd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.612313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23866012-287a-4679-acbf-9a1ac8948c7a admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.629537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30399f25-5063-4723-acc4-1b256e25bccd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.634198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba886cd-c9fa-4485-ad3d-ba21a215f04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.634865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba886cd-c9fa-4485-ad3d-ba21a215f04e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.635149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba886cd-c9fa-4485-ad3d-ba21a215f04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.635418 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba886cd-c9fa-4485-ad3d-ba21a215f04e admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.636074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba886cd-c9fa-4485-ad3d-ba21a215f04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.637946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba886cd-c9fa-4485-ad3d-ba21a215f04e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.668467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 777/1578] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.668467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba886cd-c9fa-4485-ad3d-ba21a215f04e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.671514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcee85-ae9e-4d27-aec1-cd14ae255909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.672146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcee85-ae9e-4d27-aec1-cd14ae255909 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.672428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcee85-ae9e-4d27-aec1-cd14ae255909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.672698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcee85-ae9e-4d27-aec1-cd14ae255909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.673360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcee85-ae9e-4d27-aec1-cd14ae255909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.675311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcee85-ae9e-4d27-aec1-cd14ae255909 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.705629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 802/1579] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.706559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcee85-ae9e-4d27-aec1-cd14ae255909 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.731939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba886cd-c9fa-4485-ad3d-ba21a215f04e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.773211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcee85-ae9e-4d27-aec1-cd14ae255909 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.778675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432f23d-9e33-4ca2-94d9-4db13edce46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.779381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432f23d-9e33-4ca2-94d9-4db13edce46e admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.779687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432f23d-9e33-4ca2-94d9-4db13edce46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.779967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432f23d-9e33-4ca2-94d9-4db13edce46e admin admin] PATH_INFO: `/v3/projects/a83b3c514a104e84bdba0605fd9c0aa3/users/0a83c57e879b463a9c36f3b0a3402600/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.788597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bb4ee-dca1-4ab3-863d-c09f11763bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.789261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bb4ee-dca1-4ab3-863d-c09f11763bac admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.789548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bb4ee-dca1-4ab3-863d-c09f11763bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.789825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bb4ee-dca1-4ab3-863d-c09f11763bac admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.791073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bb4ee-dca1-4ab3-863d-c09f11763bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.792975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bb4ee-dca1-4ab3-863d-c09f11763bac admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.795164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432f23d-9e33-4ca2-94d9-4db13edce46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83b3c514a104e84bdba0605fd9c0aa3, user_id=0a83c57e879b463a9c36f3b0a3402600, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.798185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432f23d-9e33-4ca2-94d9-4db13edce46e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.811461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 803/1580] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:46 2022] PUT /identity/v3/projects/a83b3c514a104e84bdba0605fd9c0aa3/users/0a83c57e879b463a9c36f3b0a3402600/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:46.812596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432f23d-9e33-4ca2-94d9-4db13edce46e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.820506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 778/1581] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.821191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bb4ee-dca1-4ab3-863d-c09f11763bac admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.833516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:46.835980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:46.882770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432f23d-9e33-4ca2-94d9-4db13edce46e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.886219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bb4ee-dca1-4ab3-863d-c09f11763bac admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.887431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6e5f5-c605-4cb4-8611-cf66741639ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.888055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e5f5-c605-4cb4-8611-cf66741639ac admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.888334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e5f5-c605-4cb4-8611-cf66741639ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.888604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e5f5-c605-4cb4-8611-cf66741639ac admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.889271 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6e5f5-c605-4cb4-8611-cf66741639ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.891042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edcfda-388b-4a4e-b87e-d41caf372f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.891264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6e5f5-c605-4cb4-8611-cf66741639ac admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.891650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edcfda-388b-4a4e-b87e-d41caf372f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.891928 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edcfda-388b-4a4e-b87e-d41caf372f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.892199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edcfda-388b-4a4e-b87e-d41caf372f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.892887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edcfda-388b-4a4e-b87e-d41caf372f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.894494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edcfda-388b-4a4e-b87e-d41caf372f13 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.905138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 779/1582] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:46.906375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edcfda-388b-4a4e-b87e-d41caf372f13 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.916531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 804/1583] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.917174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edcfda-388b-4a4e-b87e-d41caf372f13 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.917646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474730d-ac35-427a-8838-64d1ddd595ac None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.917934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474730d-ac35-427a-8838-64d1ddd595ac None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.918209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474730d-ac35-427a-8838-64d1ddd595ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.922065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e17f33-e5f2-49b8-8d9a-91ab9aa4fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.922695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e17f33-e5f2-49b8-8d9a-91ab9aa4fdfd admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.922973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e17f33-e5f2-49b8-8d9a-91ab9aa4fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.923271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e17f33-e5f2-49b8-8d9a-91ab9aa4fdfd admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.923915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e17f33-e5f2-49b8-8d9a-91ab9aa4fdfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.925811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e17f33-e5f2-49b8-8d9a-91ab9aa4fdfd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.936642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e474730d-ac35-427a-8838-64d1ddd595ac None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:46.937917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e474730d-ac35-427a-8838-64d1ddd595ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:46.946707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 805/1585] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:46.946870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 780/1585] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.950824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474730d-ac35-427a-8838-64d1ddd595ac None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.950950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e17f33-e5f2-49b8-8d9a-91ab9aa4fdfd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.960165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474730d-ac35-427a-8838-64d1ddd595ac None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.960584 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e17f33-e5f2-49b8-8d9a-91ab9aa4fdfd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:46.965332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3e7b0-c173-4a67-9040-0469d82d3539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.965741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475d42f-4e4a-450c-9e3c-a7db28a63e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:46.965941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3e7b0-c173-4a67-9040-0469d82d3539 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.966223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3e7b0-c173-4a67-9040-0469d82d3539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.966336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475d42f-4e4a-450c-9e3c-a7db28a63e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.966513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3e7b0-c173-4a67-9040-0469d82d3539 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.966629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475d42f-4e4a-450c-9e3c-a7db28a63e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.966889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475d42f-4e4a-450c-9e3c-a7db28a63e7b admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:46.967177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3e7b0-c173-4a67-9040-0469d82d3539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.967565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475d42f-4e4a-450c-9e3c-a7db28a63e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:46.969088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3e7b0-c173-4a67-9040-0469d82d3539 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.969480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475d42f-4e4a-450c-9e3c-a7db28a63e7b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:46.994904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 806/1586] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.995141 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 781/1587] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/users => generated 282 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:46.995246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96527-fc44-4c04-ad7b-5d3c337df8c9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:46.995336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475d42f-4e4a-450c-9e3c-a7db28a63e7b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:46.995422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96527-fc44-4c04-ad7b-5d3c337df8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:46.995422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96527-fc44-4c04-ad7b-5d3c337df8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.004901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475d42f-4e4a-450c-9e3c-a7db28a63e7b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.010047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531260b9-dbe3-4097-bebc-b207283c0b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.010672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531260b9-dbe3-4097-bebc-b207283c0b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.010955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531260b9-dbe3-4097-bebc-b207283c0b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.011230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531260b9-dbe3-4097-bebc-b207283c0b90 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.011878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531260b9-dbe3-4097-bebc-b207283c0b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.013775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531260b9-dbe3-4097-bebc-b207283c0b90 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.022167 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-31b96527-fc44-4c04-ad7b-5d3c337df8c9 None None] MFA Rules not processed for user `0a83c57e879b463a9c36f3b0a3402600`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:47.023678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-31b96527-fc44-4c04-ad7b-5d3c337df8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:47.037610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 782/1588] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/users => generated 285 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:47.038419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531260b9-dbe3-4097-bebc-b207283c0b90 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.051309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531260b9-dbe3-4097-bebc-b207283c0b90 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.056583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60951a90-5423-4205-bbb8-ad0eb2a5ca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.057253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60951a90-5423-4205-bbb8-ad0eb2a5ca87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.057532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60951a90-5423-4205-bbb8-ad0eb2a5ca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.057809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60951a90-5423-4205-bbb8-ad0eb2a5ca87 admin admin] PATH_INFO: `/v3/projects/5b2e4ed4c5d0455c996be0b7208d6590/users/b7d7625bb151490a91ac389021a2e0c7/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.074578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60951a90-5423-4205-bbb8-ad0eb2a5ca87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2e4ed4c5d0455c996be0b7208d6590, user_id=b7d7625bb151490a91ac389021a2e0c7, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.077317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60951a90-5423-4205-bbb8-ad0eb2a5ca87 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.090804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 783/1589] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:47 2022] PUT /identity/v3/projects/5b2e4ed4c5d0455c996be0b7208d6590/users/b7d7625bb151490a91ac389021a2e0c7/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:47.091619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60951a90-5423-4205-bbb8-ad0eb2a5ca87 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.101337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 807/1590] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:47.102265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96527-fc44-4c04-ad7b-5d3c337df8c9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.115602 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96527-fc44-4c04-ad7b-5d3c337df8c9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.178070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d6206-532b-41f1-aa90-b07cbef3429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.178739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d6206-532b-41f1-aa90-b07cbef3429f admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.179022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d6206-532b-41f1-aa90-b07cbef3429f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.179194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60951a90-5423-4205-bbb8-ad0eb2a5ca87 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.179419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d6206-532b-41f1-aa90-b07cbef3429f admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.180128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d6206-532b-41f1-aa90-b07cbef3429f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.181830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d6206-532b-41f1-aa90-b07cbef3429f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.183894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa9fbc-a282-4806-a7d3-f1ebf7686c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.184507 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa9fbc-a282-4806-a7d3-f1ebf7686c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.184788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa9fbc-a282-4806-a7d3-f1ebf7686c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.185067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa9fbc-a282-4806-a7d3-f1ebf7686c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.185815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa9fbc-a282-4806-a7d3-f1ebf7686c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.187444 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa9fbc-a282-4806-a7d3-f1ebf7686c12 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.191992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 808/1591] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:47.195815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d6206-532b-41f1-aa90-b07cbef3429f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.198471 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 784/1592] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:47.199045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa9fbc-a282-4806-a7d3-f1ebf7686c12 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.207909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:47.208629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa9fbc-a282-4806-a7d3-f1ebf7686c12 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.214115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8377a3f-fb56-48d1-bcef-f58883dfd886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.214837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8377a3f-fb56-48d1-bcef-f58883dfd886 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.215185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8377a3f-fb56-48d1-bcef-f58883dfd886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.215529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8377a3f-fb56-48d1-bcef-f58883dfd886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.216277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8377a3f-fb56-48d1-bcef-f58883dfd886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.217866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8377a3f-fb56-48d1-bcef-f58883dfd886 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.228108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 785/1593] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:47.228964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8377a3f-fb56-48d1-bcef-f58883dfd886 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.238186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8377a3f-fb56-48d1-bcef-f58883dfd886 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.242767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2babe70-ec5e-446e-8cda-7a8402b69c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.243401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2babe70-ec5e-446e-8cda-7a8402b69c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.243680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2babe70-ec5e-446e-8cda-7a8402b69c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.243947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2babe70-ec5e-446e-8cda-7a8402b69c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.244623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2babe70-ec5e-446e-8cda-7a8402b69c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.246244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2babe70-ec5e-446e-8cda-7a8402b69c1f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.256876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 786/1594] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:47.257020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d6206-532b-41f1-aa90-b07cbef3429f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.257528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2babe70-ec5e-446e-8cda-7a8402b69c1f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.261367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e319d-5809-44e0-b090-69a063ed3423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.262007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e319d-5809-44e0-b090-69a063ed3423 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.262288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e319d-5809-44e0-b090-69a063ed3423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.262598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e319d-5809-44e0-b090-69a063ed3423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.267643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2babe70-ec5e-446e-8cda-7a8402b69c1f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.272067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e319d-5809-44e0-b090-69a063ed3423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.272272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4072d-32b8-4d60-be18-f31f4d150d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.272839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4072d-32b8-4d60-be18-f31f4d150d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.273116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4072d-32b8-4d60-be18-f31f4d150d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.273383 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4072d-32b8-4d60-be18-f31f4d150d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.273531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e319d-5809-44e0-b090-69a063ed3423 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.274103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4072d-32b8-4d60-be18-f31f4d150d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.276373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4072d-32b8-4d60-be18-f31f4d150d3c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.277987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:47.290230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 787/1595] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:47.290230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829406d-cd6e-4967-97ba-27a088899fd0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.290230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829406d-cd6e-4967-97ba-27a088899fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.290230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829406d-cd6e-4967-97ba-27a088899fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.294655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 809/1596] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:47.296837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12596a60-99c1-41f8-b497-c779411f8978 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.298290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12596a60-99c1-41f8-b497-c779411f8978 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.298809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12596a60-99c1-41f8-b497-c779411f8978 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.300420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 810/1597] 10.222.0.36 () {54 vars in 962 bytes} [Thu Jul 28 02:08:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:08:47.301315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12596a60-99c1-41f8-b497-c779411f8978 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.314239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6829406d-cd6e-4967-97ba-27a088899fd0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:47.315742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6829406d-cd6e-4967-97ba-27a088899fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:47.317238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12596a60-99c1-41f8-b497-c779411f8978 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.323329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061bcf-6c79-416f-a36c-d5c88b994740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.324144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061bcf-6c79-416f-a36c-d5c88b994740 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.324278 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 788/1598] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:47.324685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061bcf-6c79-416f-a36c-d5c88b994740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.325131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061bcf-6c79-416f-a36c-d5c88b994740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.325972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35061bcf-6c79-416f-a36c-d5c88b994740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.328060 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35061bcf-6c79-416f-a36c-d5c88b994740 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.328155 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829406d-cd6e-4967-97ba-27a088899fd0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.344243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 811/1599] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:47.344896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061bcf-6c79-416f-a36c-d5c88b994740 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.349548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829406d-cd6e-4967-97ba-27a088899fd0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.356067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061bcf-6c79-416f-a36c-d5c88b994740 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.356411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3809087-2cc1-4202-87da-7d2c695d4ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.357044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3809087-2cc1-4202-87da-7d2c695d4ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.357326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3809087-2cc1-4202-87da-7d2c695d4ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.357591 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3809087-2cc1-4202-87da-7d2c695d4ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.358355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3809087-2cc1-4202-87da-7d2c695d4ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.360362 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3809087-2cc1-4202-87da-7d2c695d4ee2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.369333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73161f-e552-47f0-932b-a9de49b305d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.370099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73161f-e552-47f0-932b-a9de49b305d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.371025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73161f-e552-47f0-932b-a9de49b305d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.371305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73161f-e552-47f0-932b-a9de49b305d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.372010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73161f-e552-47f0-932b-a9de49b305d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.373627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73161f-e552-47f0-932b-a9de49b305d2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.375905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 789/1600] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:47.377186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3809087-2cc1-4202-87da-7d2c695d4ee2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.389003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3809087-2cc1-4202-87da-7d2c695d4ee2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.392275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 812/1601] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:47.393417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73161f-e552-47f0-932b-a9de49b305d2 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.395400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464bf50-72b0-41d7-8460-087546fd3398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.396060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464bf50-72b0-41d7-8460-087546fd3398 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.396338 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464bf50-72b0-41d7-8460-087546fd3398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.396655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464bf50-72b0-41d7-8460-087546fd3398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.397410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464bf50-72b0-41d7-8460-087546fd3398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.399211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464bf50-72b0-41d7-8460-087546fd3398 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.404313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73161f-e552-47f0-932b-a9de49b305d2 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.411546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 790/1602] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:47.413057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03fa6c-d401-49a5-b34a-4abc60ba820c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.414104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03fa6c-d401-49a5-b34a-4abc60ba820c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.414314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03fa6c-d401-49a5-b34a-4abc60ba820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.420046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5dec4-7b5e-4398-bf6c-72680ea7ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.420679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5dec4-7b5e-4398-bf6c-72680ea7ce20 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.420963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5dec4-7b5e-4398-bf6c-72680ea7ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.421236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5dec4-7b5e-4398-bf6c-72680ea7ce20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.422167 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5dec4-7b5e-4398-bf6c-72680ea7ce20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.423589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5dec4-7b5e-4398-bf6c-72680ea7ce20 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.441916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 813/1603] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:47.441916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5dec4-7b5e-4398-bf6c-72680ea7ce20 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.444607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-61d5dec4-7b5e-4398-bf6c-72680ea7ce20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:47.459180 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4b03fa6c-d401-49a5-b34a-4abc60ba820c None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:47.460284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5dec4-7b5e-4398-bf6c-72680ea7ce20 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.460458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4b03fa6c-d401-49a5-b34a-4abc60ba820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:47.466850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be868d-7a2c-4b2c-a4c4-30b280392b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.467136 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be868d-7a2c-4b2c-a4c4-30b280392b76 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.467689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be868d-7a2c-4b2c-a4c4-30b280392b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.467959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be868d-7a2c-4b2c-a4c4-30b280392b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.478507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be868d-7a2c-4b2c-a4c4-30b280392b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.480777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be868d-7a2c-4b2c-a4c4-30b280392b76 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.491544 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 814/1604] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:47.492236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be868d-7a2c-4b2c-a4c4-30b280392b76 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.503588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be868d-7a2c-4b2c-a4c4-30b280392b76 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.513377 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f45201-4f95-4655-9084-77bdafc45e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.514514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45201-4f95-4655-9084-77bdafc45e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.515187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45201-4f95-4655-9084-77bdafc45e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.515627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45201-4f95-4655-9084-77bdafc45e35 admin admin] PATH_INFO: `/v3/projects/ac88e006b77d49379e6abd7b1646a04f/users/7451d5de3e664f29b3a53699af7a5c60/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.537132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f45201-4f95-4655-9084-77bdafc45e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac88e006b77d49379e6abd7b1646a04f, user_id=7451d5de3e664f29b3a53699af7a5c60, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.541021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f45201-4f95-4655-9084-77bdafc45e35 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.548352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 791/1605] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Jul 28 02:08:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:47.549375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03fa6c-d401-49a5-b34a-4abc60ba820c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.562525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 815/1606] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:47 2022] PUT /identity/v3/projects/ac88e006b77d49379e6abd7b1646a04f/users/7451d5de3e664f29b3a53699af7a5c60/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:47.564462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03fa6c-d401-49a5-b34a-4abc60ba820c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.566116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f45201-4f95-4655-9084-77bdafc45e35 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.633539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538939-f0e4-45b5-ad81-8120a93d3bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.634856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538939-f0e4-45b5-ad81-8120a93d3bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.635134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538939-f0e4-45b5-ad81-8120a93d3bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.635459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538939-f0e4-45b5-ad81-8120a93d3bb6 admin admin] PATH_INFO: `/v3/projects/0c2ce6d73e6a4188a94b8f2e17bdb320/users/b6f5694fdd154f838346e10e149b1b5b/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.652333 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7538939-f0e4-45b5-ad81-8120a93d3bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2ce6d73e6a4188a94b8f2e17bdb320, user_id=b6f5694fdd154f838346e10e149b1b5b, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.655536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7538939-f0e4-45b5-ad81-8120a93d3bb6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.656377 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f45201-4f95-4655-9084-77bdafc45e35 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.663934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26417b-9cb0-4a5a-93ba-1786e244fef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.664996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26417b-9cb0-4a5a-93ba-1786e244fef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.665294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26417b-9cb0-4a5a-93ba-1786e244fef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.665787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26417b-9cb0-4a5a-93ba-1786e244fef4 admin admin] PATH_INFO: `/v3/projects/e71f921f6fd64a0ab71fc936d199854a/users/c88a4ae446ac43b48ee778344caec88c/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.685561 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 792/1607] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:47 2022] PUT /identity/v3/projects/0c2ce6d73e6a4188a94b8f2e17bdb320/users/b6f5694fdd154f838346e10e149b1b5b/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:47.686600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538939-f0e4-45b5-ad81-8120a93d3bb6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.686821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26417b-9cb0-4a5a-93ba-1786e244fef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71f921f6fd64a0ab71fc936d199854a, user_id=c88a4ae446ac43b48ee778344caec88c, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.691594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26417b-9cb0-4a5a-93ba-1786e244fef4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.716609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 816/1608] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:47 2022] PUT /identity/v3/projects/e71f921f6fd64a0ab71fc936d199854a/users/c88a4ae446ac43b48ee778344caec88c/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:47.716609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26417b-9cb0-4a5a-93ba-1786e244fef4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.738426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:47.752170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:47.806691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538939-f0e4-45b5-ad81-8120a93d3bb6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.820755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec17d8-5993-419b-b449-bfa94f7f8224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.821482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec17d8-5993-419b-b449-bfa94f7f8224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.821762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec17d8-5993-419b-b449-bfa94f7f8224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.822040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec17d8-5993-419b-b449-bfa94f7f8224 admin admin] PATH_INFO: `/v3/projects/3f74c5f4e3804047851a7b886b60ce7c/users/397e5f0c82d341e8b9d04a315ae02986/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.825344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26417b-9cb0-4a5a-93ba-1786e244fef4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:47.838650 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b96c5e-8ba8-43de-9b02-b45191437082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:47.839225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b96c5e-8ba8-43de-9b02-b45191437082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.839511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b96c5e-8ba8-43de-9b02-b45191437082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.839782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b96c5e-8ba8-43de-9b02-b45191437082 admin admin] PATH_INFO: `/v3/projects/a697f5f98ab04cc9819a52a90dbaf4d7/users/2df69aa259c44bca8df01ff2f240cb35/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.858953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec17d8-5993-419b-b449-bfa94f7f8224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f74c5f4e3804047851a7b886b60ce7c, user_id=397e5f0c82d341e8b9d04a315ae02986, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.863803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec17d8-5993-419b-b449-bfa94f7f8224 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.863945 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b96c5e-8ba8-43de-9b02-b45191437082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a697f5f98ab04cc9819a52a90dbaf4d7, user_id=2df69aa259c44bca8df01ff2f240cb35, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:47.867030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b96c5e-8ba8-43de-9b02-b45191437082 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:47.887206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 817/1609] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:47 2022] PUT /identity/v3/projects/a697f5f98ab04cc9819a52a90dbaf4d7/users/2df69aa259c44bca8df01ff2f240cb35/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:47.904337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b96c5e-8ba8-43de-9b02-b45191437082 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:47.910910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 793/1610] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:47 2022] PUT /identity/v3/projects/3f74c5f4e3804047851a7b886b60ce7c/users/397e5f0c82d341e8b9d04a315ae02986/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:47.912273 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a748b6-f846-471f-b949-c92625381bc2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:47.912559 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a748b6-f846-471f-b949-c92625381bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:47.912845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a748b6-f846-471f-b949-c92625381bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:47.971780 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-03a748b6-f846-471f-b949-c92625381bc2 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:47.973645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-03a748b6-f846-471f-b949-c92625381bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:48.008715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b96c5e-8ba8-43de-9b02-b45191437082 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:48.026375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29562-5a6b-4778-956c-78bb4133a2d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:48.027657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29562-5a6b-4778-956c-78bb4133a2d9 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.028305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29562-5a6b-4778-956c-78bb4133a2d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.028714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29562-5a6b-4778-956c-78bb4133a2d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.085898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 794/1611] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:48.087986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7889d5-8867-4ab6-99d5-46aaf23f3c4f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.088310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7889d5-8867-4ab6-99d5-46aaf23f3c4f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.088589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7889d5-8867-4ab6-99d5-46aaf23f3c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.122524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9f7889d5-8867-4ab6-99d5-46aaf23f3c4f None None] MFA Rules not processed for user `b6f5694fdd154f838346e10e149b1b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:48.123965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9f7889d5-8867-4ab6-99d5-46aaf23f3c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:48.124794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a29562-5a6b-4778-956c-78bb4133a2d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:48.126958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a29562-5a6b-4778-956c-78bb4133a2d9 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:48.146790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 818/1612] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:48.150293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7ebbc-c133-459e-8a45-6044afbafe99 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.150552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7ebbc-c133-459e-8a45-6044afbafe99 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.150833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7ebbc-c133-459e-8a45-6044afbafe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.191031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-03f7ebbc-c133-459e-8a45-6044afbafe99 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:48.192269 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-03f7ebbc-c133-459e-8a45-6044afbafe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:48.218770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 819/1613] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:48.223413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade08b1-0676-4432-a81c-ebfe74cb7a3a None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.223700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade08b1-0676-4432-a81c-ebfe74cb7a3a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.223976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade08b1-0676-4432-a81c-ebfe74cb7a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.262914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 795/1614] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:48.262914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfd2f8-a170-4855-99c4-6bb60854daa7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.262914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfd2f8-a170-4855-99c4-6bb60854daa7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.262914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfd2f8-a170-4855-99c4-6bb60854daa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.298432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4ade08b1-0676-4432-a81c-ebfe74cb7a3a None None] MFA Rules not processed for user `2df69aa259c44bca8df01ff2f240cb35`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:48.299725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4ade08b1-0676-4432-a81c-ebfe74cb7a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:48.303059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-89bfd2f8-a170-4855-99c4-6bb60854daa7 None None] MFA Rules not processed for user `397e5f0c82d341e8b9d04a315ae02986`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:48.306645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-89bfd2f8-a170-4855-99c4-6bb60854daa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:48.367430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:48.375346 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:48.430063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 820/1615] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:48.431850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade08b1-0676-4432-a81c-ebfe74cb7a3a None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:48.461651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 796/1616] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:48.461651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfd2f8-a170-4855-99c4-6bb60854daa7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:48.536587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade08b1-0676-4432-a81c-ebfe74cb7a3a None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:48.542347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d73c49-6982-4bd7-9b17-98906c0da7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:48.543043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d73c49-6982-4bd7-9b17-98906c0da7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.543605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d73c49-6982-4bd7-9b17-98906c0da7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.543889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d73c49-6982-4bd7-9b17-98906c0da7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.558765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d73c49-6982-4bd7-9b17-98906c0da7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:48.563544 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d73c49-6982-4bd7-9b17-98906c0da7c6 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:48.579680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfd2f8-a170-4855-99c4-6bb60854daa7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:48.587633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b9b2f-e537-497b-b8d5-d873750bc8a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:48.588482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9b2f-e537-497b-b8d5-d873750bc8a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.588766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9b2f-e537-497b-b8d5-d873750bc8a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.589076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 821/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:48.589222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9b2f-e537-497b-b8d5-d873750bc8a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.597228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8d26f-bd92-4f3c-80c3-6266aaff3397 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.597228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8d26f-bd92-4f3c-80c3-6266aaff3397 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.597228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8d26f-bd92-4f3c-80c3-6266aaff3397 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.599738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 822/1618] 10.222.0.36 () {54 vars in 962 bytes} [Thu Jul 28 02:08:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:08:48.601964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b9b2f-e537-497b-b8d5-d873750bc8a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:48.605185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b9b2f-e537-497b-b8d5-d873750bc8a5 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:48.605677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8d26f-bd92-4f3c-80c3-6266aaff3397 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:48.619233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 797/1619] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:48.620198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b9b2f-e537-497b-b8d5-d873750bc8a5 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:48.632735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b9b2f-e537-497b-b8d5-d873750bc8a5 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:48.633802 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8d26f-bd92-4f3c-80c3-6266aaff3397 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:48.645878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb879597-7ad4-4c26-b702-921fb2b084ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:48.647514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879597-7ad4-4c26-b702-921fb2b084ee admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.648550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9588a-073d-400d-86d7-e016c68488e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:48.649033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9588a-073d-400d-86d7-e016c68488e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.649406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9588a-073d-400d-86d7-e016c68488e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.649851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879597-7ad4-4c26-b702-921fb2b084ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.650133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879597-7ad4-4c26-b702-921fb2b084ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.650876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb879597-7ad4-4c26-b702-921fb2b084ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:48.652160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9588a-073d-400d-86d7-e016c68488e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.653764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9588a-073d-400d-86d7-e016c68488e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:48.655690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb879597-7ad4-4c26-b702-921fb2b084ee admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:48.657386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9588a-073d-400d-86d7-e016c68488e4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:48.730008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 798/1620] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:48 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:48.732582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7426e27-7e4f-40cc-a060-561d0eb1c422 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.734355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7426e27-7e4f-40cc-a060-561d0eb1c422 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.734659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7426e27-7e4f-40cc-a060-561d0eb1c422 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.746263 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 823/1621] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:48 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:48.746422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 799/1622] 10.222.0.36 () {54 vars in 912 bytes} [Thu Jul 28 02:08:48 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:08:48.746422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7426e27-7e4f-40cc-a060-561d0eb1c422 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:48.746676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc81bc-d277-43f3-b1ef-a8d9c0848285 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.747127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc81bc-d277-43f3-b1ef-a8d9c0848285 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.748164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc81bc-d277-43f3-b1ef-a8d9c0848285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.810298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-42fc81bc-d277-43f3-b1ef-a8d9c0848285 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:48.815616 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-42fc81bc-d277-43f3-b1ef-a8d9c0848285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:48.922007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7426e27-7e4f-40cc-a060-561d0eb1c422 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:48.932292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfd41e-9507-44f3-9389-53f3c7a0fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:48.933768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfd41e-9507-44f3-9389-53f3c7a0fe20 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.936019 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfd41e-9507-44f3-9389-53f3c7a0fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.937760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfd41e-9507-44f3-9389-53f3c7a0fe20 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.938616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfd41e-9507-44f3-9389-53f3c7a0fe20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:48.942861 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfd41e-9507-44f3-9389-53f3c7a0fe20 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:48.979155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 824/1623] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Jul 28 02:08:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:48.988545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed29195-d62f-4192-b6ff-112b13f8bc45 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:48.989971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed29195-d62f-4192-b6ff-112b13f8bc45 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:48.990255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed29195-d62f-4192-b6ff-112b13f8bc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:48.992164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 800/1624] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:48 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:48.994362 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfd41e-9507-44f3-9389-53f3c7a0fe20 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.017345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfd41e-9507-44f3-9389-53f3c7a0fe20 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.031438 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-bed29195-d62f-4192-b6ff-112b13f8bc45 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:49.032652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-bed29195-d62f-4192-b6ff-112b13f8bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:49.034083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc289c-022f-4138-8d22-25e45a15dfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.034790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc289c-022f-4138-8d22-25e45a15dfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.035199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc289c-022f-4138-8d22-25e45a15dfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.035473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc289c-022f-4138-8d22-25e45a15dfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.036193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc289c-022f-4138-8d22-25e45a15dfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.038118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc289c-022f-4138-8d22-25e45a15dfb6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.057871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 825/1625] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:08:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:49.064978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed29195-d62f-4192-b6ff-112b13f8bc45 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.085300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed29195-d62f-4192-b6ff-112b13f8bc45 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.092856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 801/1626] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:48 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:49.094027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc289c-022f-4138-8d22-25e45a15dfb6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.111668 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1957b-b23b-48d5-8fa8-43fec720a5ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.112317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1957b-b23b-48d5-8fa8-43fec720a5ae service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.113126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1957b-b23b-48d5-8fa8-43fec720a5ae service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.113444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1957b-b23b-48d5-8fa8-43fec720a5ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.120305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc289c-022f-4138-8d22-25e45a15dfb6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.133465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c51e50-b90e-4883-9230-8d31965ac562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.134433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c51e50-b90e-4883-9230-8d31965ac562 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.135363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c51e50-b90e-4883-9230-8d31965ac562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.135644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c51e50-b90e-4883-9230-8d31965ac562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.138506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c51e50-b90e-4883-9230-8d31965ac562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.140215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c51e50-b90e-4883-9230-8d31965ac562 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.171695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 802/1627] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:49.172612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c51e50-b90e-4883-9230-8d31965ac562 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.188770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:49.190233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:49.242660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1957b-b23b-48d5-8fa8-43fec720a5ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.244510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1957b-b23b-48d5-8fa8-43fec720a5ae service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.252622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c51e50-b90e-4883-9230-8d31965ac562 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.257672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ad01-9bdf-40d5-9d17-fc3c6659048d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.259195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ad01-9bdf-40d5-9d17-fc3c6659048d service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.259480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ad01-9bdf-40d5-9d17-fc3c6659048d service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.259750 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ad01-9bdf-40d5-9d17-fc3c6659048d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.266071 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 826/1628] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:49.266937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1957b-b23b-48d5-8fa8-43fec720a5ae service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.277248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78ad01-9bdf-40d5-9d17-fc3c6659048d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.279049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78ad01-9bdf-40d5-9d17-fc3c6659048d service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.301524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 803/1629] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:49.301524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ad01-9bdf-40d5-9d17-fc3c6659048d service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.306166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1957b-b23b-48d5-8fa8-43fec720a5ae service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.313805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ad01-9bdf-40d5-9d17-fc3c6659048d service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.319950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02f410-6c35-44ce-b3db-cfd97ce6325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.321637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f410-6c35-44ce-b3db-cfd97ce6325a admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.322039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f410-6c35-44ce-b3db-cfd97ce6325a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.322578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f410-6c35-44ce-b3db-cfd97ce6325a admin admin] PATH_INFO: `/v3/projects/61616f7ff35d4f809237a103cae5b95e/users/228ab1d6ae744e57baaced88bed6d4af/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.324003 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783a297-8e52-4eeb-b446-27322ada97c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.324727 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a297-8e52-4eeb-b446-27322ada97c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.325078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a297-8e52-4eeb-b446-27322ada97c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.325355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a297-8e52-4eeb-b446-27322ada97c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.326980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783a297-8e52-4eeb-b446-27322ada97c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.328640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783a297-8e52-4eeb-b446-27322ada97c5 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.345563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02f410-6c35-44ce-b3db-cfd97ce6325a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61616f7ff35d4f809237a103cae5b95e, user_id=228ab1d6ae744e57baaced88bed6d4af, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.349456 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02f410-6c35-44ce-b3db-cfd97ce6325a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.352633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 827/1630] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:49.359455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783a297-8e52-4eeb-b446-27322ada97c5 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.386407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783a297-8e52-4eeb-b446-27322ada97c5 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.387895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 804/1631] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:49 2022] PUT /identity/v3/projects/61616f7ff35d4f809237a103cae5b95e/users/228ab1d6ae744e57baaced88bed6d4af/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:49.393097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02f410-6c35-44ce-b3db-cfd97ce6325a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.493598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9ecf6-0b38-41f3-ad37-3412134ee6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.494279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9ecf6-0b38-41f3-ad37-3412134ee6af admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.494792 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9ecf6-0b38-41f3-ad37-3412134ee6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.495067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9ecf6-0b38-41f3-ad37-3412134ee6af admin admin] PATH_INFO: `/v3/projects/ca35ac02657241edb6b7c4d16e8d484c/users/5f2b1bbf8d7047d8910f14262d3dcb6f/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.501362 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02f410-6c35-44ce-b3db-cfd97ce6325a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.507896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719ccbb-e716-44da-8583-68dd6261afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.510122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719ccbb-e716-44da-8583-68dd6261afcd admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.510603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719ccbb-e716-44da-8583-68dd6261afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.510975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719ccbb-e716-44da-8583-68dd6261afcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.512708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719ccbb-e716-44da-8583-68dd6261afcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.515253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719ccbb-e716-44da-8583-68dd6261afcd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.529038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9ecf6-0b38-41f3-ad37-3412134ee6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca35ac02657241edb6b7c4d16e8d484c, user_id=5f2b1bbf8d7047d8910f14262d3dcb6f, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.534156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 805/1632] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:49.534670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9ecf6-0b38-41f3-ad37-3412134ee6af admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.536064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719ccbb-e716-44da-8583-68dd6261afcd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.552942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719ccbb-e716-44da-8583-68dd6261afcd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.562318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6939caa-1e24-4757-b199-d978a2d473bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.564515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6939caa-1e24-4757-b199-d978a2d473bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.565635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 828/1633] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:49 2022] PUT /identity/v3/projects/ca35ac02657241edb6b7c4d16e8d484c/users/5f2b1bbf8d7047d8910f14262d3dcb6f/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:49.568763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6939caa-1e24-4757-b199-d978a2d473bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.570065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6939caa-1e24-4757-b199-d978a2d473bc admin admin] PATH_INFO: `/v3/projects/61616f7ff35d4f809237a103cae5b95e/users/228ab1d6ae744e57baaced88bed6d4af/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.570212 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9ecf6-0b38-41f3-ad37-3412134ee6af admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.576704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6939caa-1e24-4757-b199-d978a2d473bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=61616f7ff35d4f809237a103cae5b95e, user_id=228ab1d6ae744e57baaced88bed6d4af, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.582887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6939caa-1e24-4757-b199-d978a2d473bc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.608521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 806/1634] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:49 2022] PUT /identity/v3/projects/61616f7ff35d4f809237a103cae5b95e/users/228ab1d6ae744e57baaced88bed6d4af/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:08:49.620896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907236b-9448-4f79-93b0-8185d7a22f02 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.620896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907236b-9448-4f79-93b0-8185d7a22f02 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.621337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907236b-9448-4f79-93b0-8185d7a22f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.652701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9ecf6-0b38-41f3-ad37-3412134ee6af admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.687594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0907236b-9448-4f79-93b0-8185d7a22f02 None None] MFA Rules not processed for user `228ab1d6ae744e57baaced88bed6d4af`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:49.689460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0907236b-9448-4f79-93b0-8185d7a22f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:49.743975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:49.780144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb94f08-b612-46af-8f0e-485cdfed743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.782874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94f08-b612-46af-8f0e-485cdfed743e admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.783163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94f08-b612-46af-8f0e-485cdfed743e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.785680 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94f08-b612-46af-8f0e-485cdfed743e admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.787881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb94f08-b612-46af-8f0e-485cdfed743e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.792847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb94f08-b612-46af-8f0e-485cdfed743e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.823130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 829/1635] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:08:49.832886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb94f08-b612-46af-8f0e-485cdfed743e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.843063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:49.849442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb94f08-b612-46af-8f0e-485cdfed743e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:49.855185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 807/1636] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:49 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:08:49.857741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c794225-b7ee-45ef-95e0-89977f8e427c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.859040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c794225-b7ee-45ef-95e0-89977f8e427c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.861493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c794225-b7ee-45ef-95e0-89977f8e427c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.865862 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 808/1637] 10.222.0.36 () {54 vars in 912 bytes} [Thu Jul 28 02:08:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:08:49.872020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5cd42-fff8-440c-8c83-ad127059f31d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.872426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5cd42-fff8-440c-8c83-ad127059f31d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.872699 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5cd42-fff8-440c-8c83-ad127059f31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.877441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ac072-f82a-4d1b-9c0d-de5d4b33d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:49.879707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ac072-f82a-4d1b-9c0d-de5d4b33d96c admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:49.880208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ac072-f82a-4d1b-9c0d-de5d4b33d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:49.880689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ac072-f82a-4d1b-9c0d-de5d4b33d96c admin admin] PATH_INFO: `/v3/projects/ca35ac02657241edb6b7c4d16e8d484c/users/5f2b1bbf8d7047d8910f14262d3dcb6f/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:49.883862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ac072-f82a-4d1b-9c0d-de5d4b33d96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca35ac02657241edb6b7c4d16e8d484c, user_id=5f2b1bbf8d7047d8910f14262d3dcb6f, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:49.888666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ac072-f82a-4d1b-9c0d-de5d4b33d96c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:49.903843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 830/1638] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:49 2022] PUT /identity/v3/projects/ca35ac02657241edb6b7c4d16e8d484c/users/5f2b1bbf8d7047d8910f14262d3dcb6f/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:49.906058 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ac072-f82a-4d1b-9c0d-de5d4b33d96c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:49.924476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-bba5cd42-fff8-440c-8c83-ad127059f31d None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:49.926048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bba5cd42-fff8-440c-8c83-ad127059f31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:50.003399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ac072-f82a-4d1b-9c0d-de5d4b33d96c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:50.030577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4f4c4-c4f5-4d0e-bfab-785e2c03f6a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:50.031362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4f4c4-c4f5-4d0e-bfab-785e2c03f6a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:50.031738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4f4c4-c4f5-4d0e-bfab-785e2c03f6a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:50.032119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4f4c4-c4f5-4d0e-bfab-785e2c03f6a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:50.093906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 809/1639] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:08:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:08:50.095148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368a35-31ea-4cdd-a01d-0c5462f7ff79 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:50.095432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368a35-31ea-4cdd-a01d-0c5462f7ff79 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:50.095703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368a35-31ea-4cdd-a01d-0c5462f7ff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:50.132097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-16368a35-31ea-4cdd-a01d-0c5462f7ff79 None None] MFA Rules not processed for user `5f2b1bbf8d7047d8910f14262d3dcb6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:50.133197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-16368a35-31ea-4cdd-a01d-0c5462f7ff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:50.163207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4f4c4-c4f5-4d0e-bfab-785e2c03f6a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:50.165651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4f4c4-c4f5-4d0e-bfab-785e2c03f6a4 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:50.179353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 831/1640] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:49 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:50.267570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4f4c4-c4f5-4d0e-bfab-785e2c03f6a4 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:50.280288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4f4c4-c4f5-4d0e-bfab-785e2c03f6a4 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:50.288990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c76bc-b7c4-4f70-b4c2-df9549040dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:50.290288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c76bc-b7c4-4f70-b4c2-df9549040dac service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:50.290611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c76bc-b7c4-4f70-b4c2-df9549040dac service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:50.291192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c76bc-b7c4-4f70-b4c2-df9549040dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:50.309771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 810/1641] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:50.324730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c76bc-b7c4-4f70-b4c2-df9549040dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:50.326348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c76bc-b7c4-4f70-b4c2-df9549040dac service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:50.343266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 832/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:50.452537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368a35-31ea-4cdd-a01d-0c5462f7ff79 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:50.476965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368a35-31ea-4cdd-a01d-0c5462f7ff79 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:50.488856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b951e-f88d-4758-98b6-fe6a94a35202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:50.489511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b951e-f88d-4758-98b6-fe6a94a35202 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:50.489802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b951e-f88d-4758-98b6-fe6a94a35202 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:50.490055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b951e-f88d-4758-98b6-fe6a94a35202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:50.548918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b951e-f88d-4758-98b6-fe6a94a35202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:50.550394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b951e-f88d-4758-98b6-fe6a94a35202 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:50.573963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 811/1643] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:50.770898 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c76bc-b7c4-4f70-b4c2-df9549040dac service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:50.780124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c76bc-b7c4-4f70-b4c2-df9549040dac service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:50.797144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b7f13-fe65-4bb8-98bb-0da085bbe459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:50.797813 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b7f13-fe65-4bb8-98bb-0da085bbe459 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:50.798119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b7f13-fe65-4bb8-98bb-0da085bbe459 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:50.798420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b7f13-fe65-4bb8-98bb-0da085bbe459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:50.945018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b7f13-fe65-4bb8-98bb-0da085bbe459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:50.946696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b7f13-fe65-4bb8-98bb-0da085bbe459 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:50.974150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 833/1644] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:52.106037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b951e-f88d-4758-98b6-fe6a94a35202 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:52.230131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b951e-f88d-4758-98b6-fe6a94a35202 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:52.236167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:52.236972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:52.237430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:52.238060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] PATH_INFO: `/v3/users/2df69aa259c44bca8df01ff2f240cb35` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:52.239637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df69aa259c44bca8df01ff2f240cb35)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:52.240848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:08:52.240848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: warnings.warn(msg) Jul 28 02:08:52.240848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: Jul 28 02:08:52.244102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:52.252378 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:52.382987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df69aa259c44bca8df01ff2f240cb35'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:52.389823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df69aa259c44bca8df01ff2f240cb35'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:52.407123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df69aa259c44bca8df01ff2f240cb35'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:52.452090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df69aa259c44bca8df01ff2f240cb35'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:52.458002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df69aa259c44bca8df01ff2f240cb35'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:52.528979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 812/1645] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:08:52 2022] DELETE /identity/v3/users/2df69aa259c44bca8df01ff2f240cb35 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:52.533947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4b1df-7a6c-4fdf-9de9-9e3228b48751 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:52.534501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4b1df-7a6c-4fdf-9de9-9e3228b48751 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:52.534592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4b1df-7a6c-4fdf-9de9-9e3228b48751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:52.562229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:52.577700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-3fc4b1df-7a6c-4fdf-9de9-9e3228b48751 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:52.579886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3fc4b1df-7a6c-4fdf-9de9-9e3228b48751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:52.753139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 834/1646] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:52.835403 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:52.837353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:53.044669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c3fa9-5d89-447c-9d5e-25e46fde195c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:53.056331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e1fa3-f8f4-4300-b75e-1dc9deabc0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:53.056983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1fa3-f8f4-4300-b75e-1dc9deabc0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:53.057262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1fa3-f8f4-4300-b75e-1dc9deabc0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:53.057533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1fa3-f8f4-4300-b75e-1dc9deabc0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:53.092650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e1fa3-f8f4-4300-b75e-1dc9deabc0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:53.094545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e1fa3-f8f4-4300-b75e-1dc9deabc0c1 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:53.116759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 813/1647] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:54.538787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4b1df-7a6c-4fdf-9de9-9e3228b48751 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:54.541943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3fc4b1df-7a6c-4fdf-9de9-9e3228b48751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:54.555607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4b1df-7a6c-4fdf-9de9-9e3228b48751 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:54.563449 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:54.564312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:54.564961 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:54.565340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] PATH_INFO: `/v3/projects/a697f5f98ab04cc9819a52a90dbaf4d7` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:54.567089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a697f5f98ab04cc9819a52a90dbaf4d7)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:54.568673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: WARNING py.warnings [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:08:54.568673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: warnings.warn(msg) Jul 28 02:08:54.568673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: Jul 28 02:08:54.570186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:54.711152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e1fa3-f8f4-4300-b75e-1dc9deabc0c1 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:54.713474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5b0e1fa3-f8f4-4300-b75e-1dc9deabc0c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:54.724231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a697f5f98ab04cc9819a52a90dbaf4d7', 'request_id': 'req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:54.732061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e1fa3-f8f4-4300-b75e-1dc9deabc0c1 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:54.740525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a697f5f98ab04cc9819a52a90dbaf4d7', 'request_id': 'req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:54.754706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a697f5f98ab04cc9819a52a90dbaf4d7', 'request_id': 'req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:54.810205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] The token cache is being invalidate because project a697f5f98ab04cc9819a52a90dbaf4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:08:54.810697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:54.811738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:54.816796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 835/1648] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:08:54 2022] DELETE /identity/v3/projects/a697f5f98ab04cc9819a52a90dbaf4d7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:54.822272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:54.825013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:54.884211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:54.885003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:54.885365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:54.885756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] PATH_INFO: `/v3/users/0a83c57e879b463a9c36f3b0a3402600` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:54.887235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a83c57e879b463a9c36f3b0a3402600)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:54.902795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:54.964560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:54.982729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc130e7-8d9d-4f02-80c4-88aef80e05f8 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:54.998146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a83c57e879b463a9c36f3b0a3402600'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:54.999692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a83c57e879b463a9c36f3b0a3402600'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.004322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:55.007544 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:55.010345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:55.011866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] PATH_INFO: `/v3/users/5f2b1bbf8d7047d8910f14262d3dcb6f` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:55.013918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a83c57e879b463a9c36f3b0a3402600'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.016648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2b1bbf8d7047d8910f14262d3dcb6f)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:55.022495 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:55.068291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a83c57e879b463a9c36f3b0a3402600'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.069992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4e4175c7-4534-4005-bd59-f32584cd6905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a83c57e879b463a9c36f3b0a3402600'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.091065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 814/1649] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:08:54 2022] DELETE /identity/v3/users/0a83c57e879b463a9c36f3b0a3402600 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:55.095508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2c8a-2e51-4297-8067-159d19a219ed None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:55.096040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2c8a-2e51-4297-8067-159d19a219ed None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:55.096553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2c8a-2e51-4297-8067-159d19a219ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:55.107272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:55.137475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2b1bbf8d7047d8910f14262d3dcb6f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.138266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2b1bbf8d7047d8910f14262d3dcb6f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.148081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a66d2c8a-2e51-4297-8067-159d19a219ed None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:55.149460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a66d2c8a-2e51-4297-8067-159d19a219ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:55.156605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2b1bbf8d7047d8910f14262d3dcb6f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.183503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2b1bbf8d7047d8910f14262d3dcb6f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.185461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2b1bbf8d7047d8910f14262d3dcb6f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.220985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 836/1650] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:08:54 2022] DELETE /identity/v3/users/5f2b1bbf8d7047d8910f14262d3dcb6f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:55.322146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 815/1651] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:55.354100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:55.355883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:55.536911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a98f9f-9f9c-4d49-b93d-ed46d1fa1441 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:55.547581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afb102-5294-4794-ac3c-ff8aa93ac34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:55.548931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb102-5294-4794-ac3c-ff8aa93ac34f service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:55.549519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb102-5294-4794-ac3c-ff8aa93ac34f service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:55.549929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb102-5294-4794-ac3c-ff8aa93ac34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:55.600921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d2c8a-2e51-4297-8067-159d19a219ed None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:55.603733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a66d2c8a-2e51-4297-8067-159d19a219ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:55.628098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d2c8a-2e51-4297-8067-159d19a219ed None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:55.710740 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afb102-5294-4794-ac3c-ff8aa93ac34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:55.713016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afb102-5294-4794-ac3c-ff8aa93ac34f service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:55.739243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 837/1652] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:55.780415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:55.782910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:55.783414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:55.784585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] PATH_INFO: `/v3/users/397e5f0c82d341e8b9d04a315ae02986` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:55.787646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397e5f0c82d341e8b9d04a315ae02986)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:55.790611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:55.874509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397e5f0c82d341e8b9d04a315ae02986'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.876118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397e5f0c82d341e8b9d04a315ae02986'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.880055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:55.893138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397e5f0c82d341e8b9d04a315ae02986'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.911416 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397e5f0c82d341e8b9d04a315ae02986'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.912543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397e5f0c82d341e8b9d04a315ae02986'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:55.941042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 816/1653] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:08:55 2022] DELETE /identity/v3/users/397e5f0c82d341e8b9d04a315ae02986 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:55.945921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d11e14-cdaf-450f-aa7b-26427446c475 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:55.947053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d11e14-cdaf-450f-aa7b-26427446c475 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:55.947053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d11e14-cdaf-450f-aa7b-26427446c475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:55.978051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-c6d11e14-cdaf-450f-aa7b-26427446c475 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:55.980832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c6d11e14-cdaf-450f-aa7b-26427446c475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:56.094947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:56.115334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 838/1654] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:56.120043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:56.122809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:56.161357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fca83a-6c60-4fb6-b511-d40aedc17b48 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:56.178500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:56.179461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:56.180129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:56.181140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] PATH_INFO: `/v3/projects/ca35ac02657241edb6b7c4d16e8d484c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:56.183617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca35ac02657241edb6b7c4d16e8d484c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:56.188781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d11e14-cdaf-450f-aa7b-26427446c475 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:56.190495 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c6d11e14-cdaf-450f-aa7b-26427446c475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:56.194335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:56.321740 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca35ac02657241edb6b7c4d16e8d484c', 'request_id': 'req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:56.332029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca35ac02657241edb6b7c4d16e8d484c', 'request_id': 'req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:56.340765 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca35ac02657241edb6b7c4d16e8d484c', 'request_id': 'req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:56.359510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d11e14-cdaf-450f-aa7b-26427446c475 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:56.360073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] The token cache is being invalidate because project ca35ac02657241edb6b7c4d16e8d484c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:08:56.360374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:56.361276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d4a70e65-0b8c-4589-aa6c-11ce87f3cb65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:56.363495 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 817/1655] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:08:56 2022] DELETE /identity/v3/projects/ca35ac02657241edb6b7c4d16e8d484c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:56.368931 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe92c1-5b90-44d8-a4ab-6c50e54231f6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:56.369337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe92c1-5b90-44d8-a4ab-6c50e54231f6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:56.369946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe92c1-5b90-44d8-a4ab-6c50e54231f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:56.436677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-24fe92c1-5b90-44d8-a4ab-6c50e54231f6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:56.439040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-24fe92c1-5b90-44d8-a4ab-6c50e54231f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:56.538231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169614e-6deb-4ad6-b837-3bb84f677b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:56.540393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169614e-6deb-4ad6-b837-3bb84f677b96 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:56.540393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169614e-6deb-4ad6-b837-3bb84f677b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:56.541503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169614e-6deb-4ad6-b837-3bb84f677b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:56.546539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c169614e-6deb-4ad6-b837-3bb84f677b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:56.622903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 818/1656] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:56.634245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1f6b-0ca8-49a9-ac67-b8ae96bb5a5c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:56.634695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1f6b-0ca8-49a9-ac67-b8ae96bb5a5c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:56.635341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1f6b-0ca8-49a9-ac67-b8ae96bb5a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:56.730815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169614e-6deb-4ad6-b837-3bb84f677b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:56.732852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169614e-6deb-4ad6-b837-3bb84f677b96 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:56.745416 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c40d1f6b-0ca8-49a9-ac67-b8ae96bb5a5c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:56.747864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c40d1f6b-0ca8-49a9-ac67-b8ae96bb5a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:56.749225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 839/1657] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:08:56.766338 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 819/1658] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:56.770257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169614e-6deb-4ad6-b837-3bb84f677b96 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:56.792787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169614e-6deb-4ad6-b837-3bb84f677b96 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:56.804803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc5ba-61cc-46b7-89b2-e2115a73fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:56.806205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc5ba-61cc-46b7-89b2-e2115a73fbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:56.806407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc5ba-61cc-46b7-89b2-e2115a73fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:56.806783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc5ba-61cc-46b7-89b2-e2115a73fbc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:56.807647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedc5ba-61cc-46b7-89b2-e2115a73fbc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:08:56.808004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedc5ba-61cc-46b7-89b2-e2115a73fbc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:56.811120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedc5ba-61cc-46b7-89b2-e2115a73fbc7 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:56.833623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 840/1659] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:08:56.838998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1f6b-0ca8-49a9-ac67-b8ae96bb5a5c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:56.854613 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1f6b-0ca8-49a9-ac67-b8ae96bb5a5c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:56.884196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afc917-d727-48f1-81d1-0ed88d30341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:56.885401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc917-d727-48f1-81d1-0ed88d30341c admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:56.886370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc917-d727-48f1-81d1-0ed88d30341c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:56.886941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc917-d727-48f1-81d1-0ed88d30341c admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:56.902846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afc917-d727-48f1-81d1-0ed88d30341c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:56.904891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afc917-d727-48f1-81d1-0ed88d30341c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:56.960463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 820/1660] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:56 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:56.967779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc5ba-61cc-46b7-89b2-e2115a73fbc7 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:56.987189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc5ba-61cc-46b7-89b2-e2115a73fbc7 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:57.060365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:57.094876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7424120-d7c7-439d-b42c-0702f2794d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:57.096093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424120-d7c7-439d-b42c-0702f2794d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:57.096560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424120-d7c7-439d-b42c-0702f2794d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:57.096927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424120-d7c7-439d-b42c-0702f2794d73 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:57.097847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7424120-d7c7-439d-b42c-0702f2794d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:57.101262 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7424120-d7c7-439d-b42c-0702f2794d73 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:57.140934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 841/1661] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:56 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:57.145389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afc917-d727-48f1-81d1-0ed88d30341c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:57.168881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afc917-d727-48f1-81d1-0ed88d30341c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:57.174221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c77e0-3f8d-4333-ae41-a11352f95196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:57.174938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c77e0-3f8d-4333-ae41-a11352f95196 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:57.175219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c77e0-3f8d-4333-ae41-a11352f95196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:57.175489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c77e0-3f8d-4333-ae41-a11352f95196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:57.176528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c77e0-3f8d-4333-ae41-a11352f95196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:57.178186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c77e0-3f8d-4333-ae41-a11352f95196 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:57.209922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 821/1662] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:57.214842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7424120-d7c7-439d-b42c-0702f2794d73 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:57.232769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7424120-d7c7-439d-b42c-0702f2794d73 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:57.246475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf590cf1-7fde-4af7-948d-663c8b928ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:57.247128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590cf1-7fde-4af7-948d-663c8b928ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:57.247414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590cf1-7fde-4af7-948d-663c8b928ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:57.247692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590cf1-7fde-4af7-948d-663c8b928ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:57.248427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf590cf1-7fde-4af7-948d-663c8b928ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:57.250264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf590cf1-7fde-4af7-948d-663c8b928ef9 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:57.277738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 842/1663] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:57.282363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c77e0-3f8d-4333-ae41-a11352f95196 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:57.296724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c77e0-3f8d-4333-ae41-a11352f95196 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:57.309478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9817691-512b-4c3e-9d9f-ffb9ef439959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:57.310175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817691-512b-4c3e-9d9f-ffb9ef439959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:57.310486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817691-512b-4c3e-9d9f-ffb9ef439959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:57.310757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817691-512b-4c3e-9d9f-ffb9ef439959 admin admin] PATH_INFO: `/v3/projects/d61cabb305cc4471bd6ba0dcd52faa15/users/98a7892ab8fd4ca6a2d92f33b2ed7396/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:57.314420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:57.332430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9817691-512b-4c3e-9d9f-ffb9ef439959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61cabb305cc4471bd6ba0dcd52faa15, user_id=98a7892ab8fd4ca6a2d92f33b2ed7396, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:57.337942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9817691-512b-4c3e-9d9f-ffb9ef439959 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:57.375485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 822/1664] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:57 2022] PUT /identity/v3/projects/d61cabb305cc4471bd6ba0dcd52faa15/users/98a7892ab8fd4ca6a2d92f33b2ed7396/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:57.376939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bcfdb-f3f3-48eb-b213-2a71dd68595c None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:57.377236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bcfdb-f3f3-48eb-b213-2a71dd68595c None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:57.377661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bcfdb-f3f3-48eb-b213-2a71dd68595c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:57.419981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-1b9bcfdb-f3f3-48eb-b213-2a71dd68595c None None] MFA Rules not processed for user `98a7892ab8fd4ca6a2d92f33b2ed7396`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:57.420296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372778c6-19d9-40af-9b60-fd8a8aa920cb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:57.420587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372778c6-19d9-40af-9b60-fd8a8aa920cb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:57.421405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372778c6-19d9-40af-9b60-fd8a8aa920cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:57.421516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-1b9bcfdb-f3f3-48eb-b213-2a71dd68595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:57.521064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-372778c6-19d9-40af-9b60-fd8a8aa920cb None None] MFA Rules not processed for user `b7d7625bb151490a91ac389021a2e0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:57.522518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-372778c6-19d9-40af-9b60-fd8a8aa920cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:57.562643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 843/1665] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:57.570563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bcfdb-f3f3-48eb-b213-2a71dd68595c None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:57.735735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bcfdb-f3f3-48eb-b213-2a71dd68595c None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:57.750833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e569fb2-b7ce-44d5-aa42-30e60d005c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:57.751477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e569fb2-b7ce-44d5-aa42-30e60d005c24 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:57.751755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e569fb2-b7ce-44d5-aa42-30e60d005c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:57.752027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e569fb2-b7ce-44d5-aa42-30e60d005c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:57.752701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e569fb2-b7ce-44d5-aa42-30e60d005c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:57.754696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e569fb2-b7ce-44d5-aa42-30e60d005c24 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:57.815651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 823/1666] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:57.827478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372778c6-19d9-40af-9b60-fd8a8aa920cb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:57.834337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-372778c6-19d9-40af-9b60-fd8a8aa920cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:57.845901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 844/1667] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:08:57 2022] POST /identity/v3/projects => generated 367 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:57.850764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821790d9-44c1-4426-bc7e-0923cc001921 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:57.851047 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821790d9-44c1-4426-bc7e-0923cc001921 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:57.851322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821790d9-44c1-4426-bc7e-0923cc001921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:57.888707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-821790d9-44c1-4426-bc7e-0923cc001921 None None] MFA Rules not processed for user `b7d7625bb151490a91ac389021a2e0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:57.890035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-821790d9-44c1-4426-bc7e-0923cc001921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:57.905030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372778c6-19d9-40af-9b60-fd8a8aa920cb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:57.982801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:58.048753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 845/1668] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:58.051129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821790d9-44c1-4426-bc7e-0923cc001921 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:58.069485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:58.070572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:58.071641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:58.072490 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] PATH_INFO: `/v3/projects/a83b3c514a104e84bdba0605fd9c0aa3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:58.074282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83b3c514a104e84bdba0605fd9c0aa3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:58.077295 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:58.197667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83b3c514a104e84bdba0605fd9c0aa3', 'request_id': 'req-6161b26e-670d-4cf2-8d18-2f45cf170338'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:58.229984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83b3c514a104e84bdba0605fd9c0aa3', 'request_id': 'req-6161b26e-670d-4cf2-8d18-2f45cf170338'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:58.232133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821790d9-44c1-4426-bc7e-0923cc001921 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:58.243916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83b3c514a104e84bdba0605fd9c0aa3', 'request_id': 'req-6161b26e-670d-4cf2-8d18-2f45cf170338'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:58.297685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] The token cache is being invalidate because project a83b3c514a104e84bdba0605fd9c0aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:08:58.298040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:58.302894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:58.313366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 824/1669] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:08:57 2022] DELETE /identity/v3/projects/a83b3c514a104e84bdba0605fd9c0aa3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:58.314321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:58.319553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:58.335471 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:58.411647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea58c10-ddd5-4473-973b-df2839d3161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:58.412369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea58c10-ddd5-4473-973b-df2839d3161b admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:58.412795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea58c10-ddd5-4473-973b-df2839d3161b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:58.413074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea58c10-ddd5-4473-973b-df2839d3161b admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:58.413811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea58c10-ddd5-4473-973b-df2839d3161b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:58.416378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea58c10-ddd5-4473-973b-df2839d3161b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:58.460024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 846/1670] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:08:58 2022] POST /identity/v3/users => generated 290 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:08:58.462626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea58c10-ddd5-4473-973b-df2839d3161b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:58.466224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-5ea58c10-ddd5-4473-973b-df2839d3161b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:58.502067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161b26e-670d-4cf2-8d18-2f45cf170338 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:58.517435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:58.518120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:58.518398 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:58.518700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] PATH_INFO: `/v3/users/b6f5694fdd154f838346e10e149b1b5b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:58.525149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f5694fdd154f838346e10e149b1b5b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:58.529888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:58.713581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f5694fdd154f838346e10e149b1b5b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:58.719798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f5694fdd154f838346e10e149b1b5b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:58.729629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea58c10-ddd5-4473-973b-df2839d3161b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:58.743347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fd4a3-be11-4641-a4e6-5d2a673d3342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:58.745260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fd4a3-be11-4641-a4e6-5d2a673d3342 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:58.746474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f5694fdd154f838346e10e149b1b5b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:58.753473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fd4a3-be11-4641-a4e6-5d2a673d3342 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:58.754461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fd4a3-be11-4641-a4e6-5d2a673d3342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:58.760606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d78fd4a3-be11-4641-a4e6-5d2a673d3342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:58.779815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f5694fdd154f838346e10e149b1b5b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:58.781864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06e092d8-b34a-4732-9d14-4015bc86d446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f5694fdd154f838346e10e149b1b5b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:58.836064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 825/1671] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:08:58 2022] DELETE /identity/v3/users/b6f5694fdd154f838346e10e149b1b5b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:58.840593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f725-4ac3-4d12-bb58-4fcf8a7c8ebb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:58.840823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f725-4ac3-4d12-bb58-4fcf8a7c8ebb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:58.841105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f725-4ac3-4d12-bb58-4fcf8a7c8ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:58.875869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:58.917769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-16b6f725-4ac3-4d12-bb58-4fcf8a7c8ebb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:58.923550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-16b6f725-4ac3-4d12-bb58-4fcf8a7c8ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:59.015185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fd4a3-be11-4641-a4e6-5d2a673d3342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:59.017237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fd4a3-be11-4641-a4e6-5d2a673d3342 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:59.041579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 847/1672] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:59.051136 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fd4a3-be11-4641-a4e6-5d2a673d3342 service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:59.055591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d78fd4a3-be11-4641-a4e6-5d2a673d3342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:59.083886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fd4a3-be11-4641-a4e6-5d2a673d3342 service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:59.107580 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 826/1673] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:59.109207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfdc54-8828-4f16-87c7-4b58e52bb085 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:59.109711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfdc54-8828-4f16-87c7-4b58e52bb085 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:59.110186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfdc54-8828-4f16-87c7-4b58e52bb085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:59.172724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1bbfdc54-8828-4f16-87c7-4b58e52bb085 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:59.186031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1bbfdc54-8828-4f16-87c7-4b58e52bb085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:59.214565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 827/1674] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:59.220428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70616741-f781-4e76-ba77-54df998b8550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:59.221638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfdc54-8828-4f16-87c7-4b58e52bb085 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:59.223309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70616741-f781-4e76-ba77-54df998b8550 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:59.226484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70616741-f781-4e76-ba77-54df998b8550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:59.226923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70616741-f781-4e76-ba77-54df998b8550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:59.227207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1bbfdc54-8828-4f16-87c7-4b58e52bb085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:59.228029 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70616741-f781-4e76-ba77-54df998b8550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:59.229999 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70616741-f781-4e76-ba77-54df998b8550 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:59.251329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfdc54-8828-4f16-87c7-4b58e52bb085 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:59.254969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 848/1675] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:08:59.257903 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120e80a-27c5-4a20-9020-56e076f89df2 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:59.262652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120e80a-27c5-4a20-9020-56e076f89df2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:59.263081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120e80a-27c5-4a20-9020-56e076f89df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:59.267198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:59.268018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:59.268411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:59.268795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] PATH_INFO: `/v3/projects/3f74c5f4e3804047851a7b886b60ce7c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:59.275359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f74c5f4e3804047851a7b886b60ce7c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:59.277465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:59.322608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:59.327202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-3120e80a-27c5-4a20-9020-56e076f89df2 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:08:59.330068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3120e80a-27c5-4a20-9020-56e076f89df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:59.350836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 849/1676] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:08:59.354091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120e80a-27c5-4a20-9020-56e076f89df2 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:59.358087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3120e80a-27c5-4a20-9020-56e076f89df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:59.427661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f74c5f4e3804047851a7b886b60ce7c', 'request_id': 'req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:59.442090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f74c5f4e3804047851a7b886b60ce7c', 'request_id': 'req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:59.460919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f74c5f4e3804047851a7b886b60ce7c', 'request_id': 'req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:59.497871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] The token cache is being invalidate because project 3f74c5f4e3804047851a7b886b60ce7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:08:59.502828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:59.504215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:08:59.509900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 828/1677] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:08:59 2022] DELETE /identity/v3/projects/3f74c5f4e3804047851a7b886b60ce7c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:59.510683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:59.513935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:59.517575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120e80a-27c5-4a20-9020-56e076f89df2 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:59.701919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a6bf-69f8-4b0e-bc00-7d230650eeaf admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:59.704718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f8bb3-33b4-4f65-a8ea-7d2955f869ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:59.705374 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8bb3-33b4-4f65-a8ea-7d2955f869ac service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:59.705658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8bb3-33b4-4f65-a8ea-7d2955f869ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:59.705936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8bb3-33b4-4f65-a8ea-7d2955f869ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:59.720830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6c1f8bb3-33b4-4f65-a8ea-7d2955f869ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:59.733259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d8ed2-f7b5-4ffd-a4fe-6dd3bbd7d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:59.733974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d8ed2-f7b5-4ffd-a4fe-6dd3bbd7d17e admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:59.734260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d8ed2-f7b5-4ffd-a4fe-6dd3bbd7d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:59.734575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d8ed2-f7b5-4ffd-a4fe-6dd3bbd7d17e admin admin] PATH_INFO: `/v3/projects/5bedf25a3db84d1db179b7cfc90a5ef1/users/ec3730e60b9e448689e089592f00cca7/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:59.771572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f8bb3-33b4-4f65-a8ea-7d2955f869ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:59.774780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f8bb3-33b4-4f65-a8ea-7d2955f869ac service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:59.786653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d8ed2-f7b5-4ffd-a4fe-6dd3bbd7d17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bedf25a3db84d1db179b7cfc90a5ef1, user_id=ec3730e60b9e448689e089592f00cca7, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:08:59.807189 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d8ed2-f7b5-4ffd-a4fe-6dd3bbd7d17e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:08:59.813370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 850/1678] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:08:59.819614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f8bb3-33b4-4f65-a8ea-7d2955f869ac service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:59.824182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6c1f8bb3-33b4-4f65-a8ea-7d2955f869ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:59.846617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 829/1679] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:08:59 2022] PUT /identity/v3/projects/5bedf25a3db84d1db179b7cfc90a5ef1/users/ec3730e60b9e448689e089592f00cca7/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:08:59.848944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d8ed2-f7b5-4ffd-a4fe-6dd3bbd7d17e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:08:59.851651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ac9d8ed2-f7b5-4ffd-a4fe-6dd3bbd7d17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:08:59.866780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f8bb3-33b4-4f65-a8ea-7d2955f869ac service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:08:59.893203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:08:59.989491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56124a2b-03d0-4f05-81a0-8bdfd12f54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:08:59.990229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124a2b-03d0-4f05-81a0-8bdfd12f54c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:08:59.991148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124a2b-03d0-4f05-81a0-8bdfd12f54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:08:59.991523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124a2b-03d0-4f05-81a0-8bdfd12f54c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:08:59.992295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56124a2b-03d0-4f05-81a0-8bdfd12f54c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:08:59.994412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56124a2b-03d0-4f05-81a0-8bdfd12f54c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:00.001174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56124a2b-03d0-4f05-81a0-8bdfd12f54c3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:00.028101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d8ed2-f7b5-4ffd-a4fe-6dd3bbd7d17e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:00.038034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 851/1680] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:00.040345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:00.041625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:00.042063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:00.042513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] PATH_INFO: `/v3/users/228ab1d6ae744e57baaced88bed6d4af` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:00.044181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=228ab1d6ae744e57baaced88bed6d4af)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:00.044839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38375ae0-ea42-4cf1-988f-f05e84c15d74 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:00.046597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:00.046945 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38375ae0-ea42-4cf1-988f-f05e84c15d74 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:00.050082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38375ae0-ea42-4cf1-988f-f05e84c15d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:00.114369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:00.118000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-38375ae0-ea42-4cf1-988f-f05e84c15d74 None None] MFA Rules not processed for user `80ab8a36909341869be8db4c103c4059`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:00.120989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-38375ae0-ea42-4cf1-988f-f05e84c15d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:00.187652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228ab1d6ae744e57baaced88bed6d4af'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:00.191123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228ab1d6ae744e57baaced88bed6d4af'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:00.209719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228ab1d6ae744e57baaced88bed6d4af'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:00.242402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228ab1d6ae744e57baaced88bed6d4af'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:00.245096 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228ab1d6ae744e57baaced88bed6d4af'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:00.310615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 830/1681] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:08:59 2022] DELETE /identity/v3/users/228ab1d6ae744e57baaced88bed6d4af => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:00.310615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:00.326190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:00.353746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 852/1682] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:00.361627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38375ae0-ea42-4cf1-988f-f05e84c15d74 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:00.370194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-38375ae0-ea42-4cf1-988f-f05e84c15d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:00.420141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38375ae0-ea42-4cf1-988f-f05e84c15d74 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:00.543821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff16b84-4c7a-4f5d-ab56-4259bea12255 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:00.562119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf694-810a-497d-9304-a62012644c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:00.563072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf694-810a-497d-9304-a62012644c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:00.563359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf694-810a-497d-9304-a62012644c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:00.564267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf694-810a-497d-9304-a62012644c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:00.564373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf694-810a-497d-9304-a62012644c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:00.568501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf694-810a-497d-9304-a62012644c5b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:00.608021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 831/1683] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:00.609067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf694-810a-497d-9304-a62012644c5b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:00.614872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7cdbf694-810a-497d-9304-a62012644c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:00.643777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447580-0dac-4772-a73c-cb9e58552f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:00.645072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447580-0dac-4772-a73c-cb9e58552f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:00.645508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447580-0dac-4772-a73c-cb9e58552f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:00.645918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447580-0dac-4772-a73c-cb9e58552f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:00.646819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd447580-0dac-4772-a73c-cb9e58552f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:00.649800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd447580-0dac-4772-a73c-cb9e58552f9b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:00.726546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 853/1684] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:00 2022] POST /identity/v3/projects => generated 367 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:00.727257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447580-0dac-4772-a73c-cb9e58552f9b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:00.763867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:00.795090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf694-810a-497d-9304-a62012644c5b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:00.859406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447580-0dac-4772-a73c-cb9e58552f9b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:00.879854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf641fb-6df8-4177-9404-09729f9d22b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:00.880861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf641fb-6df8-4177-9404-09729f9d22b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:00.880861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf641fb-6df8-4177-9404-09729f9d22b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:00.881099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf641fb-6df8-4177-9404-09729f9d22b2 admin admin] PATH_INFO: `/v3/projects/5bedf25a3db84d1db179b7cfc90a5ef1/users/ec3730e60b9e448689e089592f00cca7/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:00.887834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf641fb-6df8-4177-9404-09729f9d22b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bedf25a3db84d1db179b7cfc90a5ef1, user_id=ec3730e60b9e448689e089592f00cca7, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:00.890702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf641fb-6df8-4177-9404-09729f9d22b2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:00.918761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:00.945343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 854/1685] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:00 2022] PUT /identity/v3/projects/5bedf25a3db84d1db179b7cfc90a5ef1/users/ec3730e60b9e448689e089592f00cca7/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:00.946679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf641fb-6df8-4177-9404-09729f9d22b2 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:01.024405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08aa46-f152-4a7a-a9d2-6d9ec1c70bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:01.027304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08aa46-f152-4a7a-a9d2-6d9ec1c70bd2 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:01.027600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08aa46-f152-4a7a-a9d2-6d9ec1c70bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:01.027888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08aa46-f152-4a7a-a9d2-6d9ec1c70bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:01.159167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08aa46-f152-4a7a-a9d2-6d9ec1c70bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:01.161455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08aa46-f152-4a7a-a9d2-6d9ec1c70bd2 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:01.162412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf641fb-6df8-4177-9404-09729f9d22b2 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:01.179995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598c128-ecd0-49a3-8a45-a64441eb0cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:01.181693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598c128-ecd0-49a3-8a45-a64441eb0cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:01.182186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598c128-ecd0-49a3-8a45-a64441eb0cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:01.182704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598c128-ecd0-49a3-8a45-a64441eb0cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:01.183613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598c128-ecd0-49a3-8a45-a64441eb0cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:01.185918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598c128-ecd0-49a3-8a45-a64441eb0cc3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:01.204169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 832/1686] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:01.208602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52fa3-d771-4865-9031-d961bd521589 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:01.208863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52fa3-d771-4865-9031-d961bd521589 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:01.209111 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52fa3-d771-4865-9031-d961bd521589 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:01.210577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 833/1687] 10.222.0.36 () {54 vars in 912 bytes} [Thu Jul 28 02:09:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:09:01.211723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d338d2-6471-4580-902d-658f9ef1984e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:01.214327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d338d2-6471-4580-902d-658f9ef1984e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:01.214632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d338d2-6471-4580-902d-658f9ef1984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:01.232437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 855/1688] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:00 2022] POST /identity/v3/users => generated 284 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:01.233906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598c128-ecd0-49a3-8a45-a64441eb0cc3 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:01.240648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-5598c128-ecd0-49a3-8a45-a64441eb0cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:01.270125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598c128-ecd0-49a3-8a45-a64441eb0cc3 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:01.275695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-81d338d2-6471-4580-902d-658f9ef1984e None None] MFA Rules not processed for user `ec3730e60b9e448689e089592f00cca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:01.276945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-81d338d2-6471-4580-902d-658f9ef1984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:01.282913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:01.284007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:01.285304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:01.285914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] PATH_INFO: `/v3/projects/61616f7ff35d4f809237a103cae5b95e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:01.288349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61616f7ff35d4f809237a103cae5b95e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:01.292867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:01.407389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61616f7ff35d4f809237a103cae5b95e', 'request_id': 'req-f4506ccb-c94e-4a08-8550-c31190937c74'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:01.434225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61616f7ff35d4f809237a103cae5b95e', 'request_id': 'req-f4506ccb-c94e-4a08-8550-c31190937c74'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:01.447144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61616f7ff35d4f809237a103cae5b95e', 'request_id': 'req-f4506ccb-c94e-4a08-8550-c31190937c74'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:01.479326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] The token cache is being invalidate because project 61616f7ff35d4f809237a103cae5b95e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:01.479630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:01.480980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f4506ccb-c94e-4a08-8550-c31190937c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:01.488566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 856/1689] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:01 2022] DELETE /identity/v3/projects/61616f7ff35d4f809237a103cae5b95e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:01.491109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5815d0-7f8b-4832-881d-ca62f07dc3b2 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:01.491422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5815d0-7f8b-4832-881d-ca62f07dc3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:01.492117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5815d0-7f8b-4832-881d-ca62f07dc3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:01.497477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 834/1690] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:01.498943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d338d2-6471-4580-902d-658f9ef1984e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:01.521315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d338d2-6471-4580-902d-658f9ef1984e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:01.607255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-de5815d0-7f8b-4832-881d-ca62f07dc3b2 None None] MFA Rules not processed for user `50bf5763fbf94aa9b438a1be6ce88c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:01.608943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-de5815d0-7f8b-4832-881d-ca62f07dc3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:01.643637 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:01.661302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ae6da-d3f1-492c-aabe-0d73228e1bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:01.661949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae6da-d3f1-492c-aabe-0d73228e1bad admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:01.662231 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae6da-d3f1-492c-aabe-0d73228e1bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:01.665284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae6da-d3f1-492c-aabe-0d73228e1bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:01.666302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ae6da-d3f1-492c-aabe-0d73228e1bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:01.669183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ae6da-d3f1-492c-aabe-0d73228e1bad admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:01.672331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:01.700986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 835/1691] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:01.706910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ae6da-d3f1-492c-aabe-0d73228e1bad admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:01.712993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d25ae6da-d3f1-492c-aabe-0d73228e1bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:01.732763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ae6da-d3f1-492c-aabe-0d73228e1bad admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:01.737597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:01.738390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:01.739095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:01.739095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] PATH_INFO: `/v3/projects/0c2ce6d73e6a4188a94b8f2e17bdb320` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:01.740154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2ce6d73e6a4188a94b8f2e17bdb320)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:01.751575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:01.786703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 857/1692] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:09:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:01.788249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92c548-d814-40fe-acaf-f44563a982ba None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:01.788543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92c548-d814-40fe-acaf-f44563a982ba None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:01.788827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92c548-d814-40fe-acaf-f44563a982ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:01.843010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ee92c548-d814-40fe-acaf-f44563a982ba None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:01.849115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ee92c548-d814-40fe-acaf-f44563a982ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:01.855510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2ce6d73e6a4188a94b8f2e17bdb320', 'request_id': 'req-d969051f-5561-412e-8bd6-d65ec49d1efb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:01.869760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2ce6d73e6a4188a94b8f2e17bdb320', 'request_id': 'req-d969051f-5561-412e-8bd6-d65ec49d1efb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:01.878992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2ce6d73e6a4188a94b8f2e17bdb320', 'request_id': 'req-d969051f-5561-412e-8bd6-d65ec49d1efb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:01.914138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] The token cache is being invalidate because project 0c2ce6d73e6a4188a94b8f2e17bdb320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:01.915846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:01.916775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:01.921047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 836/1693] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:01 2022] DELETE /identity/v3/projects/0c2ce6d73e6a4188a94b8f2e17bdb320 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:01.922676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:01.940218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.005349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 858/1694] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:02.006261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92c548-d814-40fe-acaf-f44563a982ba None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:02.009090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ee92c548-d814-40fe-acaf-f44563a982ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.041156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92c548-d814-40fe-acaf-f44563a982ba None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:02.051997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969051f-5561-412e-8bd6-d65ec49d1efb admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:02.057104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f744960-0ae8-4e71-9e79-b99e4862a2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:02.057993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744960-0ae8-4e71-9e79-b99e4862a2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.058432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744960-0ae8-4e71-9e79-b99e4862a2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.059020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744960-0ae8-4e71-9e79-b99e4862a2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.059442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75667558-1be7-4739-8a67-53bea19fcb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:02.060078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75667558-1be7-4739-8a67-53bea19fcb7c admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.061383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75667558-1be7-4739-8a67-53bea19fcb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.061383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75667558-1be7-4739-8a67-53bea19fcb7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.061383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75667558-1be7-4739-8a67-53bea19fcb7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:02.063246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75667558-1be7-4739-8a67-53bea19fcb7c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:02.064192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1f744960-0ae8-4e71-9e79-b99e4862a2e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.097411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 859/1695] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:02.097411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75667558-1be7-4739-8a67-53bea19fcb7c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:02.099996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-75667558-1be7-4739-8a67-53bea19fcb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.211234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f744960-0ae8-4e71-9e79-b99e4862a2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:02.213992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f744960-0ae8-4e71-9e79-b99e4862a2e9 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:02.252238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 837/1696] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:02.256765 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bb37a-d23f-4293-a8c9-12fb1a5486eb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.258084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bb37a-d23f-4293-a8c9-12fb1a5486eb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.260895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bb37a-d23f-4293-a8c9-12fb1a5486eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.282021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75667558-1be7-4739-8a67-53bea19fcb7c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:02.297830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c31a5-3a0c-4bd8-84fc-2c7a6d387d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:02.308945 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c31a5-3a0c-4bd8-84fc-2c7a6d387d53 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.311194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c31a5-3a0c-4bd8-84fc-2c7a6d387d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.312536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c31a5-3a0c-4bd8-84fc-2c7a6d387d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.318068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6f0c31a5-3a0c-4bd8-84fc-2c7a6d387d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.319433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f03bb37a-d23f-4293-a8c9-12fb1a5486eb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:02.322607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f03bb37a-d23f-4293-a8c9-12fb1a5486eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.348741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 838/1697] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:02.352139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01fa8f-3ded-42b3-8712-78e34f49ef9f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.358336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01fa8f-3ded-42b3-8712-78e34f49ef9f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.359070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c31a5-3a0c-4bd8-84fc-2c7a6d387d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:02.359324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01fa8f-3ded-42b3-8712-78e34f49ef9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.360847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c31a5-3a0c-4bd8-84fc-2c7a6d387d53 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:02.384364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7a01fa8f-3ded-42b3-8712-78e34f49ef9f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:02.385795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7a01fa8f-3ded-42b3-8712-78e34f49ef9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.388783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 860/1698] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:02.389858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c31a5-3a0c-4bd8-84fc-2c7a6d387d53 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:02.407585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 839/1699] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:02.415390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729fc63-c773-4491-9767-28fda7b788f4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.416742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729fc63-c773-4491-9767-28fda7b788f4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.418036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729fc63-c773-4491-9767-28fda7b788f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.421432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c31a5-3a0c-4bd8-84fc-2c7a6d387d53 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:02.433495 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbbc9b-a3e2-40ac-8aac-2c032f3a1100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:02.434298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbbc9b-a3e2-40ac-8aac-2c032f3a1100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.434784 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbbc9b-a3e2-40ac-8aac-2c032f3a1100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.435598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbbc9b-a3e2-40ac-8aac-2c032f3a1100 admin admin] PATH_INFO: `/v3/projects/02dc9233c1d24add9310341724778669/users/a4065a6418ec4e5a9056a81c8bd52c94/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.469344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbbc9b-a3e2-40ac-8aac-2c032f3a1100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02dc9233c1d24add9310341724778669, user_id=a4065a6418ec4e5a9056a81c8bd52c94, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:02.473588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbbc9b-a3e2-40ac-8aac-2c032f3a1100 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:02.485502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4729fc63-c773-4491-9767-28fda7b788f4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:02.486243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4729fc63-c773-4491-9767-28fda7b788f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.544285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 840/1700] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:02.545822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729fc63-c773-4491-9767-28fda7b788f4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:02.548721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4729fc63-c773-4491-9767-28fda7b788f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.565656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 861/1701] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:02 2022] PUT /identity/v3/projects/02dc9233c1d24add9310341724778669/users/a4065a6418ec4e5a9056a81c8bd52c94/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:02.568867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbbc9b-a3e2-40ac-8aac-2c032f3a1100 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:02.599472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729fc63-c773-4491-9767-28fda7b788f4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:02.623944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:02.631354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:02.708887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbbc9b-a3e2-40ac-8aac-2c032f3a1100 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:02.724164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7845c69-7d85-4913-8d24-7e62b083512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:02.726849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7845c69-7d85-4913-8d24-7e62b083512b admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.730229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7845c69-7d85-4913-8d24-7e62b083512b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.730229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7845c69-7d85-4913-8d24-7e62b083512b admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.731904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7845c69-7d85-4913-8d24-7e62b083512b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:02.734383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7845c69-7d85-4913-8d24-7e62b083512b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:02.739967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7845c69-7d85-4913-8d24-7e62b083512b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:02.751526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4f541-8d74-47d0-bcb3-076007a6665e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:02.753069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4f541-8d74-47d0-bcb3-076007a6665e service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.757387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4f541-8d74-47d0-bcb3-076007a6665e service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.758394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4f541-8d74-47d0-bcb3-076007a6665e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.763873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4dc4f541-8d74-47d0-bcb3-076007a6665e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.784524 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 862/1702] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:02.787306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7845c69-7d85-4913-8d24-7e62b083512b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:02.813911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7845c69-7d85-4913-8d24-7e62b083512b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:02.829439 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3ed0a-b6ff-404b-9ee2-c750e98a1338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:02.830885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3ed0a-b6ff-404b-9ee2-c750e98a1338 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.831438 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3ed0a-b6ff-404b-9ee2-c750e98a1338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.831909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3ed0a-b6ff-404b-9ee2-c750e98a1338 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.836459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3ed0a-b6ff-404b-9ee2-c750e98a1338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:02.837295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3ed0a-b6ff-404b-9ee2-c750e98a1338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:02.839910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3ed0a-b6ff-404b-9ee2-c750e98a1338 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:02.881367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 863/1703] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:02.884185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c904c-88fb-43c3-b7c6-d8a151c094c2 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:02.887317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c904c-88fb-43c3-b7c6-d8a151c094c2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:02.887814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c904c-88fb-43c3-b7c6-d8a151c094c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:02.936195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4f541-8d74-47d0-bcb3-076007a6665e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:02.939120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4f541-8d74-47d0-bcb3-076007a6665e service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:02.958652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-643c904c-88fb-43c3-b7c6-d8a151c094c2 None None] MFA Rules not processed for user `a4065a6418ec4e5a9056a81c8bd52c94`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:02.961124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-643c904c-88fb-43c3-b7c6-d8a151c094c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:02.975614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 841/1704] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:02.977356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4f541-8d74-47d0-bcb3-076007a6665e service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:03.007641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4f541-8d74-47d0-bcb3-076007a6665e service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:03.019815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf327c-af30-4981-8250-e8129fcb178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:03.020463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf327c-af30-4981-8250-e8129fcb178c admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:03.020740 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf327c-af30-4981-8250-e8129fcb178c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:03.021014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf327c-af30-4981-8250-e8129fcb178c admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:03.029767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf327c-af30-4981-8250-e8129fcb178c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:03.031911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf327c-af30-4981-8250-e8129fcb178c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:03.120976 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 842/1705] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:02 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:03.122505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf327c-af30-4981-8250-e8129fcb178c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:03.171456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 864/1706] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:03.171456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c904c-88fb-43c3-b7c6-d8a151c094c2 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:03.204617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c904c-88fb-43c3-b7c6-d8a151c094c2 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:03.303997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5fc81-89c1-4d62-8060-85915e72e340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:03.305520 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5fc81-89c1-4d62-8060-85915e72e340 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:03.306533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5fc81-89c1-4d62-8060-85915e72e340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:03.306825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5fc81-89c1-4d62-8060-85915e72e340 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:03.307797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5fc81-89c1-4d62-8060-85915e72e340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:03.310551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5fc81-89c1-4d62-8060-85915e72e340 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:03.328898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf327c-af30-4981-8250-e8129fcb178c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:03.341874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7efe-2c78-46d6-bca8-8429a83edc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:03.343155 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7efe-2c78-46d6-bca8-8429a83edc9e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:03.343606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7efe-2c78-46d6-bca8-8429a83edc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:03.344196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7efe-2c78-46d6-bca8-8429a83edc9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:03.353828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b7efe-2c78-46d6-bca8-8429a83edc9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:03.357555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 865/1707] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:03 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:03.358611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5fc81-89c1-4d62-8060-85915e72e340 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:03.365112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b7efe-2c78-46d6-bca8-8429a83edc9e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:03.455329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:03.460521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 843/1708] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:03 2022] POST /identity/v3/projects => generated 403 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:03.462243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7efe-2c78-46d6-bca8-8429a83edc9e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:03.517758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5fc81-89c1-4d62-8060-85915e72e340 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:03.568311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:03.713411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7efe-2c78-46d6-bca8-8429a83edc9e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:03.739224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ec311-f031-4401-9f4a-3a2b4efc5d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:03.741505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ec311-f031-4401-9f4a-3a2b4efc5d7c service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:03.741902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ec311-f031-4401-9f4a-3a2b4efc5d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:03.742186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ec311-f031-4401-9f4a-3a2b4efc5d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:03.746591 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b71b1-b32f-4231-8b28-df838344d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:03.747407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b71b1-b32f-4231-8b28-df838344d9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:03.747691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b71b1-b32f-4231-8b28-df838344d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:03.747967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b71b1-b32f-4231-8b28-df838344d9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:03.748687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b71b1-b32f-4231-8b28-df838344d9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:03.755645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b71b1-b32f-4231-8b28-df838344d9bd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:03.795872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 844/1709] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:03.798350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b71b1-b32f-4231-8b28-df838344d9bd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:03.829682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b71b1-b32f-4231-8b28-df838344d9bd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:03.844501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ebce0-a184-405d-aa3b-632e326172f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:03.845296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ebce0-a184-405d-aa3b-632e326172f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:03.845579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ebce0-a184-405d-aa3b-632e326172f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:03.845856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ebce0-a184-405d-aa3b-632e326172f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:03.850296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ebce0-a184-405d-aa3b-632e326172f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:03.855015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ec311-f031-4401-9f4a-3a2b4efc5d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:03.856624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ec311-f031-4401-9f4a-3a2b4efc5d7c service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:03.858696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ebce0-a184-405d-aa3b-632e326172f2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:03.869725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 866/1710] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:03.871050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ec311-f031-4401-9f4a-3a2b4efc5d7c service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:03.883786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ec311-f031-4401-9f4a-3a2b4efc5d7c service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:03.889958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccfb8f-785d-41b9-863a-addfb10ba079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:03.890976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccfb8f-785d-41b9-863a-addfb10ba079 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:03.891440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccfb8f-785d-41b9-863a-addfb10ba079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:03.891863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccfb8f-785d-41b9-863a-addfb10ba079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:03.892724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccfb8f-785d-41b9-863a-addfb10ba079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:03.894685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccfb8f-785d-41b9-863a-addfb10ba079 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:03.910214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 867/1711] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:03.913896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccfb8f-785d-41b9-863a-addfb10ba079 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:03.927909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccfb8f-785d-41b9-863a-addfb10ba079 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:03.940257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e0d66-5960-4e9c-ae4a-ce5edd2b9d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:03.941163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e0d66-5960-4e9c-ae4a-ce5edd2b9d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:03.941442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e0d66-5960-4e9c-ae4a-ce5edd2b9d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:03.941719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e0d66-5960-4e9c-ae4a-ce5edd2b9d04 admin admin] PATH_INFO: `/v3/projects/4e854f4ae7a04c56a7832ac8246f9cf4/users/5ea35181966b4abca8196df5e3445ce2/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:03.955142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 845/1712] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:03 2022] POST /identity/v3/users => generated 302 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:03.960539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ebce0-a184-405d-aa3b-632e326172f2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:03.964827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e0d66-5960-4e9c-ae4a-ce5edd2b9d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e854f4ae7a04c56a7832ac8246f9cf4, user_id=5ea35181966b4abca8196df5e3445ce2, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:03.968730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e0d66-5960-4e9c-ae4a-ce5edd2b9d04 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:03.985293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ebce0-a184-405d-aa3b-632e326172f2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:04.001993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bbb00-c005-4f9b-81d0-7d9c2f126407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:04.002700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bbb00-c005-4f9b-81d0-7d9c2f126407 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:04.009460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bbb00-c005-4f9b-81d0-7d9c2f126407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:04.009807 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bbb00-c005-4f9b-81d0-7d9c2f126407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:04.013817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bbb00-c005-4f9b-81d0-7d9c2f126407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:04.015554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bbb00-c005-4f9b-81d0-7d9c2f126407 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:04.018942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 868/1713] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:03 2022] PUT /identity/v3/projects/4e854f4ae7a04c56a7832ac8246f9cf4/users/5ea35181966b4abca8196df5e3445ce2/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:04.029839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa3e0-0e9a-43c1-89fb-4fdd6e3a57e3 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:04.030124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa3e0-0e9a-43c1-89fb-4fdd6e3a57e3 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:04.030401 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa3e0-0e9a-43c1-89fb-4fdd6e3a57e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:04.081822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 846/1714] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:04.082218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ba0aa3e0-0e9a-43c1-89fb-4fdd6e3a57e3 None None] MFA Rules not processed for user `5ea35181966b4abca8196df5e3445ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:04.083948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ba0aa3e0-0e9a-43c1-89fb-4fdd6e3a57e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:04.092161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bbb00-c005-4f9b-81d0-7d9c2f126407 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:04.145325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bbb00-c005-4f9b-81d0-7d9c2f126407 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:04.244996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:04.262604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 869/1715] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:04.266328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa3e0-0e9a-43c1-89fb-4fdd6e3a57e3 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:04.361365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029ba01-5e9b-4d09-8f16-e3833efb9120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:04.364423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029ba01-5e9b-4d09-8f16-e3833efb9120 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:04.365882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029ba01-5e9b-4d09-8f16-e3833efb9120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:04.367016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029ba01-5e9b-4d09-8f16-e3833efb9120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:04.369502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029ba01-5e9b-4d09-8f16-e3833efb9120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:04.375051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029ba01-5e9b-4d09-8f16-e3833efb9120 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:04.400381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 847/1716] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:04.408089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029ba01-5e9b-4d09-8f16-e3833efb9120 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:04.422336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029ba01-5e9b-4d09-8f16-e3833efb9120 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:04.435455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5238a6-b8f9-422e-b0ce-a77a4614cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:04.436751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5238a6-b8f9-422e-b0ce-a77a4614cd10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:04.436884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5238a6-b8f9-422e-b0ce-a77a4614cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:04.437628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5238a6-b8f9-422e-b0ce-a77a4614cd10 admin admin] PATH_INFO: `/v3/projects/79ef69a63ace4c3caac3aa9c164f1452/users/c9e07818a8c54e318bd521ae4710bcd3/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:04.467546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5238a6-b8f9-422e-b0ce-a77a4614cd10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ef69a63ace4c3caac3aa9c164f1452, user_id=c9e07818a8c54e318bd521ae4710bcd3, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:04.471988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5238a6-b8f9-422e-b0ce-a77a4614cd10 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:04.496181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 848/1717] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:04 2022] PUT /identity/v3/projects/79ef69a63ace4c3caac3aa9c164f1452/users/c9e07818a8c54e318bd521ae4710bcd3/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:04.502725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97deea4-daf0-4d16-aaf6-1dc3b1a08619 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:04.503477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97deea4-daf0-4d16-aaf6-1dc3b1a08619 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:04.503763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa3e0-0e9a-43c1-89fb-4fdd6e3a57e3 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:04.505204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97deea4-daf0-4d16-aaf6-1dc3b1a08619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:04.549313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c97deea4-daf0-4d16-aaf6-1dc3b1a08619 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:04.556027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c97deea4-daf0-4d16-aaf6-1dc3b1a08619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:04.737840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dcd8f-b271-41eb-bcc8-80040865afa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:04.738662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dcd8f-b271-41eb-bcc8-80040865afa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:04.738950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dcd8f-b271-41eb-bcc8-80040865afa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:04.739227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dcd8f-b271-41eb-bcc8-80040865afa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:04.739921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dcd8f-b271-41eb-bcc8-80040865afa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:04.743122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dcd8f-b271-41eb-bcc8-80040865afa2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:04.808476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 849/1718] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:04.808476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1014-1f74-415b-94af-9010fbcc14d3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:04.808476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1014-1f74-415b-94af-9010fbcc14d3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:04.808476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1014-1f74-415b-94af-9010fbcc14d3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:04.809649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 850/1719] 10.222.0.36 () {54 vars in 961 bytes} [Thu Jul 28 02:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:09:04.817997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce85af-2b12-46d6-8a86-dab3187e0531 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:04.818272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce85af-2b12-46d6-8a86-dab3187e0531 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:04.818585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce85af-2b12-46d6-8a86-dab3187e0531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:04.851202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 870/1720] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:04 2022] POST /identity/v3/projects => generated 387 bytes in 585 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:04.852245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dcd8f-b271-41eb-bcc8-80040865afa2 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:04.858544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:04.884171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a7ce85af-2b12-46d6-8a86-dab3187e0531 None None] MFA Rules not processed for user `e041d38c69cd4626898bc1412f5ed1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:04.892217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a7ce85af-2b12-46d6-8a86-dab3187e0531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:05.072913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dcd8f-b271-41eb-bcc8-80040865afa2 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:05.098631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b3685-018d-4934-b36b-a7949ed93166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:05.099281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b3685-018d-4934-b36b-a7949ed93166 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:05.099561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b3685-018d-4934-b36b-a7949ed93166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:05.099833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b3685-018d-4934-b36b-a7949ed93166 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:05.100520 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b3685-018d-4934-b36b-a7949ed93166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:05.103507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b3685-018d-4934-b36b-a7949ed93166 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:05.146405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 851/1721] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Jul 28 02:09:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:05.147474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce85af-2b12-46d6-8a86-dab3187e0531 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:05.155101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a7ce85af-2b12-46d6-8a86-dab3187e0531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:05.178790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 871/1722] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:04 2022] POST /identity/v3/users => generated 300 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:05.179442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b3685-018d-4934-b36b-a7949ed93166 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:05.226857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b3685-018d-4934-b36b-a7949ed93166 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:05.251676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e517628-84b1-4854-902c-4385e9d3292b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:05.252320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e517628-84b1-4854-902c-4385e9d3292b service placement] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:05.252930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e517628-84b1-4854-902c-4385e9d3292b service placement] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:05.252930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e517628-84b1-4854-902c-4385e9d3292b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:05.264492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-1e517628-84b1-4854-902c-4385e9d3292b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:05.296363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e517628-84b1-4854-902c-4385e9d3292b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:05.298025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e517628-84b1-4854-902c-4385e9d3292b service placement] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:05.355243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce85af-2b12-46d6-8a86-dab3187e0531 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:05.358051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 872/1723] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:05.377831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e517628-84b1-4854-902c-4385e9d3292b service placement] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:05.383727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737e9df-d437-40a9-8040-a9c47d074a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:05.388932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737e9df-d437-40a9-8040-a9c47d074a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:05.391201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737e9df-d437-40a9-8040-a9c47d074a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:05.392259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737e9df-d437-40a9-8040-a9c47d074a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:05.418636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e517628-84b1-4854-902c-4385e9d3292b service placement] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:05.434629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737e9df-d437-40a9-8040-a9c47d074a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:05.436330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737e9df-d437-40a9-8040-a9c47d074a82 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:05.442952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbbe78-a161-4f18-bc22-135e74391f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:05.446742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbbe78-a161-4f18-bc22-135e74391f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:05.449549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbbe78-a161-4f18-bc22-135e74391f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:05.451055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbbe78-a161-4f18-bc22-135e74391f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:05.454275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbbe78-a161-4f18-bc22-135e74391f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:05.457849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbbe78-a161-4f18-bc22-135e74391f83 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:05.469495 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:05.483335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 852/1724] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:05.533478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 873/1725] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:05.534403 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737e9df-d437-40a9-8040-a9c47d074a82 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:05.555688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737e9df-d437-40a9-8040-a9c47d074a82 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:05.566549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048cb7-58a8-417d-af6e-319556b1db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:05.566721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048cb7-58a8-417d-af6e-319556b1db6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:05.566929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048cb7-58a8-417d-af6e-319556b1db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:05.567581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048cb7-58a8-417d-af6e-319556b1db6c admin admin] PATH_INFO: `/v3/projects/95116d8d45e847ceb5cdbc94b8f57531/users/23497b085de0474bad272e50b35d6e3e/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:05.606595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c048cb7-58a8-417d-af6e-319556b1db6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95116d8d45e847ceb5cdbc94b8f57531, user_id=23497b085de0474bad272e50b35d6e3e, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:05.615513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c048cb7-58a8-417d-af6e-319556b1db6c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:05.645081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 853/1726] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:05 2022] PUT /identity/v3/projects/95116d8d45e847ceb5cdbc94b8f57531/users/23497b085de0474bad272e50b35d6e3e/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:05.649205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbbe78-a161-4f18-bc22-135e74391f83 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:05.661675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbbe78-a161-4f18-bc22-135e74391f83 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:05.897424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7603f-9a37-4f2a-8c49-de9f8276e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:05.898614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7603f-9a37-4f2a-8c49-de9f8276e76c admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:05.899150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7603f-9a37-4f2a-8c49-de9f8276e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:05.900613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7603f-9a37-4f2a-8c49-de9f8276e76c admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:05.901564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7603f-9a37-4f2a-8c49-de9f8276e76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:05.903670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7603f-9a37-4f2a-8c49-de9f8276e76c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:05.921058 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 874/1727] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:05.921711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048cb7-58a8-417d-af6e-319556b1db6c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:05.941074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048cb7-58a8-417d-af6e-319556b1db6c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:05.968384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecbb57-e77f-4634-ad78-3562006178e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:05.971905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecbb57-e77f-4634-ad78-3562006178e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:05.972202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecbb57-e77f-4634-ad78-3562006178e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:05.975256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecbb57-e77f-4634-ad78-3562006178e3 admin admin] PATH_INFO: `/v3/projects/95116d8d45e847ceb5cdbc94b8f57531/users/23497b085de0474bad272e50b35d6e3e/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:05.984125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecbb57-e77f-4634-ad78-3562006178e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95116d8d45e847ceb5cdbc94b8f57531, user_id=23497b085de0474bad272e50b35d6e3e, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:05.992161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecbb57-e77f-4634-ad78-3562006178e3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:06.037489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 854/1728] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:05 2022] PUT /identity/v3/projects/95116d8d45e847ceb5cdbc94b8f57531/users/23497b085de0474bad272e50b35d6e3e/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:06.049309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41b80b-d290-45a9-bbf8-46d2082ac859 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:06.049601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41b80b-d290-45a9-bbf8-46d2082ac859 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:06.049919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41b80b-d290-45a9-bbf8-46d2082ac859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:06.128151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-2f41b80b-d290-45a9-bbf8-46d2082ac859 None None] MFA Rules not processed for user `23497b085de0474bad272e50b35d6e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:06.135451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2f41b80b-d290-45a9-bbf8-46d2082ac859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:06.354511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 875/1729] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:06.374483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecbb57-e77f-4634-ad78-3562006178e3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:06.472156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecbb57-e77f-4634-ad78-3562006178e3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:06.478151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6083333-6cf4-49a9-8d32-95e3438f92f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:06.479008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6083333-6cf4-49a9-8d32-95e3438f92f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:06.479582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6083333-6cf4-49a9-8d32-95e3438f92f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:06.480008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6083333-6cf4-49a9-8d32-95e3438f92f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:06.494352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6083333-6cf4-49a9-8d32-95e3438f92f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:06.497808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6083333-6cf4-49a9-8d32-95e3438f92f8 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:06.529559 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 855/1730] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:06.651959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41b80b-d290-45a9-bbf8-46d2082ac859 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:06.841630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41b80b-d290-45a9-bbf8-46d2082ac859 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:06.859659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab646-febf-4337-91ca-1938dc900a98 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:06.859942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab646-febf-4337-91ca-1938dc900a98 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:06.860222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab646-febf-4337-91ca-1938dc900a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:06.863018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:06.864588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:06.865105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:06.865253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] PATH_INFO: `/v3/users/5ea35181966b4abca8196df5e3445ce2` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:06.869462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea35181966b4abca8196df5e3445ce2)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:06.875026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:06.922821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:06.932613 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fdbab646-febf-4337-91ca-1938dc900a98 None None] MFA Rules not processed for user `7451d5de3e664f29b3a53699af7a5c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:06.934565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fdbab646-febf-4337-91ca-1938dc900a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:06.945120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:07.004658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea35181966b4abca8196df5e3445ce2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:07.007190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea35181966b4abca8196df5e3445ce2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:07.021555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea35181966b4abca8196df5e3445ce2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:07.028187 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 856/1731] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:07.047406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbab646-febf-4337-91ca-1938dc900a98 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:07.048858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fdbab646-febf-4337-91ca-1938dc900a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:07.057632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea35181966b4abca8196df5e3445ce2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:07.058535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6cd0e941-318d-4462-8e12-a4ec1af73782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea35181966b4abca8196df5e3445ce2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:07.115013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 876/1732] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:06 2022] DELETE /identity/v3/users/5ea35181966b4abca8196df5e3445ce2 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:07.115013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49e843-5dc4-4b0e-8845-d6f61fc67b5f None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:07.115239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49e843-5dc4-4b0e-8845-d6f61fc67b5f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:07.115518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49e843-5dc4-4b0e-8845-d6f61fc67b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:07.168133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-7a49e843-5dc4-4b0e-8845-d6f61fc67b5f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:07.169530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7a49e843-5dc4-4b0e-8845-d6f61fc67b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:07.246348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbab646-febf-4337-91ca-1938dc900a98 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:07.361797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 877/1733] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:07.369073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49e843-5dc4-4b0e-8845-d6f61fc67b5f None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:07.372059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7a49e843-5dc4-4b0e-8845-d6f61fc67b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:07.515361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6dfa4-16b8-46e4-aa25-acaa48e92454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:07.515361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6dfa4-16b8-46e4-aa25-acaa48e92454 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:07.515361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6dfa4-16b8-46e4-aa25-acaa48e92454 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:07.517040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6dfa4-16b8-46e4-aa25-acaa48e92454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:07.522919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9cf6dfa4-16b8-46e4-aa25-acaa48e92454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:07.540186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49e843-5dc4-4b0e-8845-d6f61fc67b5f None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:07.550526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfda06-cb33-4949-aa6f-2715caea26d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:07.551175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfda06-cb33-4949-aa6f-2715caea26d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:07.551461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfda06-cb33-4949-aa6f-2715caea26d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:07.551736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfda06-cb33-4949-aa6f-2715caea26d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:07.590625 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfda06-cb33-4949-aa6f-2715caea26d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:07.592159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfda06-cb33-4949-aa6f-2715caea26d9 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:07.637061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 878/1734] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:09:07.664792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:07.730188 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6dfa4-16b8-46e4-aa25-acaa48e92454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:07.732534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6dfa4-16b8-46e4-aa25-acaa48e92454 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:07.752250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 857/1735] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:09:08.186078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfda06-cb33-4949-aa6f-2715caea26d9 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:08.187842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7ccfda06-cb33-4949-aa6f-2715caea26d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:08.209089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfda06-cb33-4949-aa6f-2715caea26d9 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:08.227552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:08.229435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:08.229860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:08.230226 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] PATH_INFO: `/v3/users/98a7892ab8fd4ca6a2d92f33b2ed7396` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:08.234312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a7892ab8fd4ca6a2d92f33b2ed7396)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:08.237481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:08.344222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:08.364334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a7892ab8fd4ca6a2d92f33b2ed7396'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:08.365311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a7892ab8fd4ca6a2d92f33b2ed7396'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:08.384466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a7892ab8fd4ca6a2d92f33b2ed7396'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:08.438011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a7892ab8fd4ca6a2d92f33b2ed7396'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:08.439027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d1d3747b-e1ce-41b7-93c5-f705af448d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a7892ab8fd4ca6a2d92f33b2ed7396'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:08.486896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 879/1736] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:08 2022] DELETE /identity/v3/users/98a7892ab8fd4ca6a2d92f33b2ed7396 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:08.494074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3dd1e-50fa-4dd5-b877-583081a9ab8b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:08.494578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3dd1e-50fa-4dd5-b877-583081a9ab8b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:08.494942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3dd1e-50fa-4dd5-b877-583081a9ab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:08.558472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1aa3dd1e-50fa-4dd5-b877-583081a9ab8b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:08.560069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1aa3dd1e-50fa-4dd5-b877-583081a9ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:08.716326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 858/1737] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:08.781822 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28ee8f-0ffb-4ea1-a3a5-d683ac7d2942 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:08.783084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28ee8f-0ffb-4ea1-a3a5-d683ac7d2942 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:08.783487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28ee8f-0ffb-4ea1-a3a5-d683ac7d2942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:08.795721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3dd1e-50fa-4dd5-b877-583081a9ab8b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:08.797295 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1aa3dd1e-50fa-4dd5-b877-583081a9ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:08.873069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ee28ee8f-0ffb-4ea1-a3a5-d683ac7d2942 None None] MFA Rules not processed for user `c9e07818a8c54e318bd521ae4710bcd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:08.876453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ee28ee8f-0ffb-4ea1-a3a5-d683ac7d2942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:08.974020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3dd1e-50fa-4dd5-b877-583081a9ab8b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:08.990644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d95e-cc48-484b-a8ed-508e7d4f089d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:08.991330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d95e-cc48-484b-a8ed-508e7d4f089d service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:08.991608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d95e-cc48-484b-a8ed-508e7d4f089d service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:08.991881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d95e-cc48-484b-a8ed-508e7d4f089d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:09.032944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353d95e-cc48-484b-a8ed-508e7d4f089d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:09.034914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353d95e-cc48-484b-a8ed-508e7d4f089d service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:09.060804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 859/1738] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:09.079537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 880/1739] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:09.084266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d95e-cc48-484b-a8ed-508e7d4f089d service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:09.087769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4353d95e-cc48-484b-a8ed-508e7d4f089d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:09.142837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d95e-cc48-484b-a8ed-508e7d4f089d service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:09.156889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb22be-7b81-4c16-a910-de2c61a84708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:09.162027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb22be-7b81-4c16-a910-de2c61a84708 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:09.162027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb22be-7b81-4c16-a910-de2c61a84708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:09.162027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb22be-7b81-4c16-a910-de2c61a84708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:09.166196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb22be-7b81-4c16-a910-de2c61a84708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:09.175705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb22be-7b81-4c16-a910-de2c61a84708 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:09.196934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28ee8f-0ffb-4ea1-a3a5-d683ac7d2942 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:09.198612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ee28ee8f-0ffb-4ea1-a3a5-d683ac7d2942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:09.224554 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28ee8f-0ffb-4ea1-a3a5-d683ac7d2942 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:09.230357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:09.232164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:09.232448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:09.233481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] PATH_INFO: `/v3/projects/4e854f4ae7a04c56a7832ac8246f9cf4` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:09.234811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e854f4ae7a04c56a7832ac8246f9cf4)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:09.237082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:09.262193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 860/1740] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:09 2022] POST /identity/v3/projects => generated 405 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:09.263859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9650-f6c4-4df1-896c-de103c1c4727 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:09.264159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9650-f6c4-4df1-896c-de103c1c4727 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:09.264436 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9650-f6c4-4df1-896c-de103c1c4727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:09.353744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e854f4ae7a04c56a7832ac8246f9cf4', 'request_id': 'req-ca98c15a-af1c-4dff-befa-56568600ea85'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:09.367119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e854f4ae7a04c56a7832ac8246f9cf4', 'request_id': 'req-ca98c15a-af1c-4dff-befa-56568600ea85'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:09.385483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f17d9650-f6c4-4df1-896c-de103c1c4727 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:09.386768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f17d9650-f6c4-4df1-896c-de103c1c4727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:09.392066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e854f4ae7a04c56a7832ac8246f9cf4', 'request_id': 'req-ca98c15a-af1c-4dff-befa-56568600ea85'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:09.428735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] The token cache is being invalidate because project 4e854f4ae7a04c56a7832ac8246f9cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:09.428916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:09.435754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:09.446548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 881/1741] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:09 2022] DELETE /identity/v3/projects/4e854f4ae7a04c56a7832ac8246f9cf4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:09.448095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:09.469256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:09.478757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:09.585439 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 861/1742] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:09:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:09.587213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d9650-f6c4-4df1-896c-de103c1c4727 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:09.592865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f17d9650-f6c4-4df1-896c-de103c1c4727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:09.600141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:09.680861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98c15a-af1c-4dff-befa-56568600ea85 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:09.686411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a67fd1-314e-4a27-b150-dd16225a6114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:09.687024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a67fd1-314e-4a27-b150-dd16225a6114 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:09.687407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a67fd1-314e-4a27-b150-dd16225a6114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:09.687924 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a67fd1-314e-4a27-b150-dd16225a6114 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:09.689052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a67fd1-314e-4a27-b150-dd16225a6114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:09.691645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a67fd1-314e-4a27-b150-dd16225a6114 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:09.728496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 882/1743] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:09 2022] POST /identity/v3/users => generated 309 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:09.730534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a67fd1-314e-4a27-b150-dd16225a6114 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:09.747962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a67fd1-314e-4a27-b150-dd16225a6114 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:09.756118 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b890e8-4fc2-48e9-a426-64707d01faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:09.756863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b890e8-4fc2-48e9-a426-64707d01faf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:09.757215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b890e8-4fc2-48e9-a426-64707d01faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:09.757560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b890e8-4fc2-48e9-a426-64707d01faf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:09.759098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b890e8-4fc2-48e9-a426-64707d01faf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:09.761435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b890e8-4fc2-48e9-a426-64707d01faf4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:09.785393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d9650-f6c4-4df1-896c-de103c1c4727 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:09.794346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 883/1744] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:09.798595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b890e8-4fc2-48e9-a426-64707d01faf4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:09.799447 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:09.800126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:09.800458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:09.800740 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] PATH_INFO: `/v3/users/23497b085de0474bad272e50b35d6e3e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:09.804826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23497b085de0474bad272e50b35d6e3e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:09.807249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:09.829104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b890e8-4fc2-48e9-a426-64707d01faf4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:09.848064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c99394-a27b-4b05-b551-608b77fd98ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:09.848865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99394-a27b-4b05-b551-608b77fd98ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:09.849015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99394-a27b-4b05-b551-608b77fd98ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:09.849291 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99394-a27b-4b05-b551-608b77fd98ff admin admin] PATH_INFO: `/v3/projects/611112cf99b24e68b36d63c577c5c476/users/43ccbbf2b2124c28b7f8e5d8e18fe624/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:09.896121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c99394-a27b-4b05-b551-608b77fd98ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=611112cf99b24e68b36d63c577c5c476, user_id=43ccbbf2b2124c28b7f8e5d8e18fe624, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:09.899764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c99394-a27b-4b05-b551-608b77fd98ff admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:09.963805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 884/1745] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:09 2022] PUT /identity/v3/projects/611112cf99b24e68b36d63c577c5c476/users/43ccbbf2b2124c28b7f8e5d8e18fe624/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:09.964856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23497b085de0474bad272e50b35d6e3e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:09.966185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23497b085de0474bad272e50b35d6e3e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:09.968064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c99394-a27b-4b05-b551-608b77fd98ff admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:09.971912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-46c99394-a27b-4b05-b551-608b77fd98ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:09.989247 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23497b085de0474bad272e50b35d6e3e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:10.019630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23497b085de0474bad272e50b35d6e3e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:10.020862 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23497b085de0474bad272e50b35d6e3e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:10.054594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 862/1746] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:09 2022] DELETE /identity/v3/users/23497b085de0474bad272e50b35d6e3e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:10.056226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:10.061047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:10.188069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:10.233327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c99394-a27b-4b05-b551-608b77fd98ff admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:10.236828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e6d8b-b332-4974-ba92-b8667191476e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:10.247421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9f2a-327a-4029-8ebd-d9ca7589fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:10.250487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9f2a-327a-4029-8ebd-d9ca7589fa53 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:10.250487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9f2a-327a-4029-8ebd-d9ca7589fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:10.251001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9f2a-327a-4029-8ebd-d9ca7589fa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:10.251988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b9f2a-327a-4029-8ebd-d9ca7589fa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:10.254929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b9f2a-327a-4029-8ebd-d9ca7589fa53 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:10.298594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 863/1747] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:10.303783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9f2a-327a-4029-8ebd-d9ca7589fa53 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:10.342331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9f2a-327a-4029-8ebd-d9ca7589fa53 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:10.357388 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf9a31-f681-42ef-b91a-4fdc5aadf8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:10.358238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf9a31-f681-42ef-b91a-4fdc5aadf8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:10.360121 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf9a31-f681-42ef-b91a-4fdc5aadf8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:10.360505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf9a31-f681-42ef-b91a-4fdc5aadf8b9 admin admin] PATH_INFO: `/v3/projects/611112cf99b24e68b36d63c577c5c476/users/43ccbbf2b2124c28b7f8e5d8e18fe624/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:10.367892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf9a31-f681-42ef-b91a-4fdc5aadf8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=611112cf99b24e68b36d63c577c5c476, user_id=43ccbbf2b2124c28b7f8e5d8e18fe624, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:10.386415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf9a31-f681-42ef-b91a-4fdc5aadf8b9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:10.415089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 864/1748] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:10 2022] PUT /identity/v3/projects/611112cf99b24e68b36d63c577c5c476/users/43ccbbf2b2124c28b7f8e5d8e18fe624/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:10.429081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:10.453320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92d27-6ecc-435e-9512-a40c53fca44e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:10.454112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92d27-6ecc-435e-9512-a40c53fca44e service swift] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:10.454579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92d27-6ecc-435e-9512-a40c53fca44e service swift] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:10.455062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92d27-6ecc-435e-9512-a40c53fca44e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:10.457177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e9c92d27-6ecc-435e-9512-a40c53fca44e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:10.580107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c92d27-6ecc-435e-9512-a40c53fca44e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:10.582382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c92d27-6ecc-435e-9512-a40c53fca44e service swift] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:10.594213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 885/1749] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:09:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:09:10.839849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d62bcd-377a-41da-9a64-2b5bfa04d296 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:10.840431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d62bcd-377a-41da-9a64-2b5bfa04d296 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:10.840820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d62bcd-377a-41da-9a64-2b5bfa04d296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:10.954376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d9d62bcd-377a-41da-9a64-2b5bfa04d296 None None] MFA Rules not processed for user `80ab8a36909341869be8db4c103c4059`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:10.959342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d9d62bcd-377a-41da-9a64-2b5bfa04d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:11.227497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 865/1750] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:11.699177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92d27-6ecc-435e-9512-a40c53fca44e service swift] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:11.700726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e9c92d27-6ecc-435e-9512-a40c53fca44e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:11.707209 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a786a7-cbb5-4187-82cb-486004b4fa8c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:11.707574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a786a7-cbb5-4187-82cb-486004b4fa8c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:11.707922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a786a7-cbb5-4187-82cb-486004b4fa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:11.750295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92d27-6ecc-435e-9512-a40c53fca44e service swift] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:11.803923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-11a786a7-cbb5-4187-82cb-486004b4fa8c None None] MFA Rules not processed for user `c88a4ae446ac43b48ee778344caec88c`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:11.821267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-11a786a7-cbb5-4187-82cb-486004b4fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:12.072405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:12.073064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:12.073348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:12.073620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] PATH_INFO: `/v3/projects/d61cabb305cc4471bd6ba0dcd52faa15` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:12.078076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61cabb305cc4471bd6ba0dcd52faa15)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:12.081074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:12.119953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 866/1751] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:12.131171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5024-f1f8-44ab-8d64-0fadc4500f23 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:12.131650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5024-f1f8-44ab-8d64-0fadc4500f23 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:12.132114 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5024-f1f8-44ab-8d64-0fadc4500f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:12.185101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-796c5024-f1f8-44ab-8d64-0fadc4500f23 None None] MFA Rules not processed for user `c88a4ae446ac43b48ee778344caec88c`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:12.193438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-796c5024-f1f8-44ab-8d64-0fadc4500f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:12.213049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61cabb305cc4471bd6ba0dcd52faa15', 'request_id': 'req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:12.234688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61cabb305cc4471bd6ba0dcd52faa15', 'request_id': 'req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:12.258706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61cabb305cc4471bd6ba0dcd52faa15', 'request_id': 'req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:12.292447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] The token cache is being invalidate because project d61cabb305cc4471bd6ba0dcd52faa15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:12.292796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:12.296246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:12.304337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 886/1752] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:11 2022] DELETE /identity/v3/projects/d61cabb305cc4471bd6ba0dcd52faa15 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:12.305843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:12.310698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:12.432136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 867/1753] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:12.456668 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:12.564074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7a24b-b7d1-4c13-8e62-f39d8d571bb1 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:12.581646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:12.584077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:12.584513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:12.585141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] PATH_INFO: `/v3/users/ec3730e60b9e448689e089592f00cca7` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:12.590854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3730e60b9e448689e089592f00cca7)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:12.599462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:12.745767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3730e60b9e448689e089592f00cca7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:12.748150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3730e60b9e448689e089592f00cca7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:12.758700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5024-f1f8-44ab-8d64-0fadc4500f23 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:12.763480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-796c5024-f1f8-44ab-8d64-0fadc4500f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:12.764994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3730e60b9e448689e089592f00cca7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:12.803916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:12.815503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3730e60b9e448689e089592f00cca7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:12.816483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3730e60b9e448689e089592f00cca7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:12.843575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 887/1754] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:12 2022] DELETE /identity/v3/users/ec3730e60b9e448689e089592f00cca7 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:13.048115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5024-f1f8-44ab-8d64-0fadc4500f23 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:13.278081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726335b-2235-428f-af05-02299ef62703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:13.285984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726335b-2235-428f-af05-02299ef62703 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:13.285984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726335b-2235-428f-af05-02299ef62703 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:13.286907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726335b-2235-428f-af05-02299ef62703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:13.292527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5726335b-2235-428f-af05-02299ef62703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:13.470532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726335b-2235-428f-af05-02299ef62703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:13.472473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726335b-2235-428f-af05-02299ef62703 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:13.499410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 868/1755] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:13.985995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:13.988236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:14.071139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726335b-2235-428f-af05-02299ef62703 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:14.073601 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5726335b-2235-428f-af05-02299ef62703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:14.268488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764a1a4-0118-46f8-90f2-c0fa8908947c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:14.285850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:14.286737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:14.287061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:14.287337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] PATH_INFO: `/v3/projects/95116d8d45e847ceb5cdbc94b8f57531` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:14.291032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95116d8d45e847ceb5cdbc94b8f57531)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:14.293460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:14.371624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:14.472844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726335b-2235-428f-af05-02299ef62703 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:14.487313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:14.490305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:14.491224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:14.491429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] PATH_INFO: `/v3/projects/5bedf25a3db84d1db179b7cfc90a5ef1` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:14.497400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bedf25a3db84d1db179b7cfc90a5ef1)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:14.507308 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:14.560474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95116d8d45e847ceb5cdbc94b8f57531', 'request_id': 'req-44ef6446-1ba3-40a4-8aed-491217e55063'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:14.566529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:14.576521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95116d8d45e847ceb5cdbc94b8f57531', 'request_id': 'req-44ef6446-1ba3-40a4-8aed-491217e55063'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:14.593886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95116d8d45e847ceb5cdbc94b8f57531', 'request_id': 'req-44ef6446-1ba3-40a4-8aed-491217e55063'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:14.636032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] The token cache is being invalidate because project 95116d8d45e847ceb5cdbc94b8f57531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:14.636384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:14.638424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-44ef6446-1ba3-40a4-8aed-491217e55063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:14.640942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 888/1756] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:13 2022] DELETE /identity/v3/projects/95116d8d45e847ceb5cdbc94b8f57531 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:14.642361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f57f22-6837-4845-a637-53421f5ea5f7 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:14.642843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f57f22-6837-4845-a637-53421f5ea5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:14.643122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f57f22-6837-4845-a637-53421f5ea5f7 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:14.651081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 889/1757] 10.222.0.36 () {54 vars in 912 bytes} [Thu Jul 28 02:09:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:09:14.652621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1048631-229a-4421-a815-89228f8352b9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:14.652911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1048631-229a-4421-a815-89228f8352b9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:14.653238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1048631-229a-4421-a815-89228f8352b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:14.718937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f1048631-229a-4421-a815-89228f8352b9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:14.721073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f1048631-229a-4421-a815-89228f8352b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:14.748529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bedf25a3db84d1db179b7cfc90a5ef1', 'request_id': 'req-ec207f67-f1c8-4ab5-8171-e65606172acf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:14.778084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bedf25a3db84d1db179b7cfc90a5ef1', 'request_id': 'req-ec207f67-f1c8-4ab5-8171-e65606172acf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:14.809723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bedf25a3db84d1db179b7cfc90a5ef1', 'request_id': 'req-ec207f67-f1c8-4ab5-8171-e65606172acf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:14.863220 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] The token cache is being invalidate because project 5bedf25a3db84d1db179b7cfc90a5ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:14.863220 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:14.865939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec207f67-f1c8-4ab5-8171-e65606172acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:14.874158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 869/1758] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:14 2022] DELETE /identity/v3/projects/5bedf25a3db84d1db179b7cfc90a5ef1 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:14.876546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08e87-85ee-4530-b0aa-37e4f14f5de3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:14.878653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08e87-85ee-4530-b0aa-37e4f14f5de3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:14.880233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08e87-85ee-4530-b0aa-37e4f14f5de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:14.955291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4de08e87-85ee-4530-b0aa-37e4f14f5de3 None None] MFA Rules not processed for user `50bf5763fbf94aa9b438a1be6ce88c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:14.956901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4de08e87-85ee-4530-b0aa-37e4f14f5de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:15.028527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 890/1759] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:15.050583 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a596-dfe4-4d57-98f2-b6cafced4c29 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.051194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a596-dfe4-4d57-98f2-b6cafced4c29 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.057678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a596-dfe4-4d57-98f2-b6cafced4c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.134759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-28f5a596-dfe4-4d57-98f2-b6cafced4c29 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:15.140362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-28f5a596-dfe4-4d57-98f2-b6cafced4c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:15.164217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 891/1760] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:15.167607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42145aa3-f47e-465c-91b0-80d499858a12 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.168192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42145aa3-f47e-465c-91b0-80d499858a12 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.169042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42145aa3-f47e-465c-91b0-80d499858a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.190408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 870/1761] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:09:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:15.207716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e689761-6be4-44a6-a6c9-15e3d85c50d1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.209007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e689761-6be4-44a6-a6c9-15e3d85c50d1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.209811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e689761-6be4-44a6-a6c9-15e3d85c50d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.294339 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7e689761-6be4-44a6-a6c9-15e3d85c50d1 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:15.295676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7e689761-6be4-44a6-a6c9-15e3d85c50d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:15.306998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-42145aa3-f47e-465c-91b0-80d499858a12 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:15.308389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-42145aa3-f47e-465c-91b0-80d499858a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:15.319156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 871/1762] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:15.321414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9293b1-90eb-4574-a1f0-2fc2ee06a21a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.322810 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9293b1-90eb-4574-a1f0-2fc2ee06a21a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.323365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9293b1-90eb-4574-a1f0-2fc2ee06a21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.374828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cb9293b1-90eb-4574-a1f0-2fc2ee06a21a None None] MFA Rules not processed for user `50bf5763fbf94aa9b438a1be6ce88c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:15.375521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 892/1763] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:15.376407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cb9293b1-90eb-4574-a1f0-2fc2ee06a21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:15.377563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42145aa3-f47e-465c-91b0-80d499858a12 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:15.385885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-42145aa3-f47e-465c-91b0-80d499858a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:15.395705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 872/1764] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Jul 28 02:09:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:15.397002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9293b1-90eb-4574-a1f0-2fc2ee06a21a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:15.421509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9293b1-90eb-4574-a1f0-2fc2ee06a21a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:15.435979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c61b2-8831-44ee-a4a0-c3db597b575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:15.436714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c61b2-8831-44ee-a4a0-c3db597b575e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.437104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c61b2-8831-44ee-a4a0-c3db597b575e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.437488 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c61b2-8831-44ee-a4a0-c3db597b575e admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.438353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c61b2-8831-44ee-a4a0-c3db597b575e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:15.439089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c61b2-8831-44ee-a4a0-c3db597b575e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:15.440876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c61b2-8831-44ee-a4a0-c3db597b575e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:15.444431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42145aa3-f47e-465c-91b0-80d499858a12 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:15.481979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0245e3-a565-4f9f-bd78-0a80f6b40967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:15.487620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 873/1765] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:15.487620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c61b2-8831-44ee-a4a0-c3db597b575e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:15.487873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0245e3-a565-4f9f-bd78-0a80f6b40967 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.487873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0245e3-a565-4f9f-bd78-0a80f6b40967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.487873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0245e3-a565-4f9f-bd78-0a80f6b40967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.511354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c61b2-8831-44ee-a4a0-c3db597b575e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:15.534360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc84f14-8682-49f1-afc8-533b0e6dcb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:15.534825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc84f14-8682-49f1-afc8-533b0e6dcb6c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.535131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc84f14-8682-49f1-afc8-533b0e6dcb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.535413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc84f14-8682-49f1-afc8-533b0e6dcb6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.536137 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc84f14-8682-49f1-afc8-533b0e6dcb6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:15.539727 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0245e3-a565-4f9f-bd78-0a80f6b40967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:15.541744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc84f14-8682-49f1-afc8-533b0e6dcb6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:15.543220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0245e3-a565-4f9f-bd78-0a80f6b40967 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:15.546183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc84f14-8682-49f1-afc8-533b0e6dcb6c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:15.596929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 874/1766] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:15.598221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc84f14-8682-49f1-afc8-533b0e6dcb6c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:15.610107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 893/1767] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:15.616151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0245e3-a565-4f9f-bd78-0a80f6b40967 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:15.624798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc84f14-8682-49f1-afc8-533b0e6dcb6c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:15.627158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9b0245e3-a565-4f9f-bd78-0a80f6b40967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:15.633621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f29b7-b8fb-4e96-8663-05f9b7b81a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:15.634656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f29b7-b8fb-4e96-8663-05f9b7b81a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.635084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f29b7-b8fb-4e96-8663-05f9b7b81a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.635590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f29b7-b8fb-4e96-8663-05f9b7b81a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.636505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f29b7-b8fb-4e96-8663-05f9b7b81a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:15.639845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f29b7-b8fb-4e96-8663-05f9b7b81a1a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:15.682864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0245e3-a565-4f9f-bd78-0a80f6b40967 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:15.702172 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144e088-5643-4094-a582-237eaf45e124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:15.702902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144e088-5643-4094-a582-237eaf45e124 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.703185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144e088-5643-4094-a582-237eaf45e124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.703460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144e088-5643-4094-a582-237eaf45e124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.734578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144e088-5643-4094-a582-237eaf45e124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:15.738997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144e088-5643-4094-a582-237eaf45e124 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:15.773720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 894/1768] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:15.781378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71630ac-8539-49ae-8799-c60b9e75e07a None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.782117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 875/1769] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:15 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:15.783089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71630ac-8539-49ae-8799-c60b9e75e07a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.783404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71630ac-8539-49ae-8799-c60b9e75e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.784151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f29b7-b8fb-4e96-8663-05f9b7b81a1a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:15.863623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:15.868769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d71630ac-8539-49ae-8799-c60b9e75e07a None None] MFA Rules not processed for user `7451d5de3e664f29b3a53699af7a5c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:15.870233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d71630ac-8539-49ae-8799-c60b9e75e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:15.923293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f29b7-b8fb-4e96-8663-05f9b7b81a1a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:15.940702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb50cc-96d1-4489-8c26-56c7ebc9aef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:15.946060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb50cc-96d1-4489-8c26-56c7ebc9aef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:15.946060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb50cc-96d1-4489-8c26-56c7ebc9aef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:15.946563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb50cc-96d1-4489-8c26-56c7ebc9aef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:15.948085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb50cc-96d1-4489-8c26-56c7ebc9aef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:15.956600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb50cc-96d1-4489-8c26-56c7ebc9aef4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:16.032894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 876/1770] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:15 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:16.034244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb50cc-96d1-4489-8c26-56c7ebc9aef4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:16.156058 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 895/1771] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:16.159537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71630ac-8539-49ae-8799-c60b9e75e07a None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:16.218371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71630ac-8539-49ae-8799-c60b9e75e07a None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:16.332555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb50cc-96d1-4489-8c26-56c7ebc9aef4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:16.339108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7ba33-de83-4c16-a065-d5b1e692476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:16.339757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7ba33-de83-4c16-a065-d5b1e692476d admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:16.340077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7ba33-de83-4c16-a065-d5b1e692476d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:16.340423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7ba33-de83-4c16-a065-d5b1e692476d admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:16.341269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7ba33-de83-4c16-a065-d5b1e692476d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:16.343726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7ba33-de83-4c16-a065-d5b1e692476d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:16.351168 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:16.388841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1796b-de4d-4adb-8672-4b79a063bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:16.389693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1796b-de4d-4adb-8672-4b79a063bed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:16.390134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1796b-de4d-4adb-8672-4b79a063bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:16.391330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1796b-de4d-4adb-8672-4b79a063bed9 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:16.396258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1796b-de4d-4adb-8672-4b79a063bed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:16.396409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 877/1772] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:16 2022] POST /identity/v3/users => generated 293 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:16.401368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7ba33-de83-4c16-a065-d5b1e692476d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:16.403891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1796b-de4d-4adb-8672-4b79a063bed9 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:16.436948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7ba33-de83-4c16-a065-d5b1e692476d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:16.457316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c937b-4c3f-4939-bbf7-e4f3400da0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:16.458047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c937b-4c3f-4939-bbf7-e4f3400da0fd admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:16.458250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c937b-4c3f-4939-bbf7-e4f3400da0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:16.458658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c937b-4c3f-4939-bbf7-e4f3400da0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:16.459429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c937b-4c3f-4939-bbf7-e4f3400da0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:16.460993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c937b-4c3f-4939-bbf7-e4f3400da0fd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:16.482178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 896/1773] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:16 2022] POST /identity/v3/users => generated 294 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:16.483627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1796b-de4d-4adb-8672-4b79a063bed9 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:16.505741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 878/1774] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:16.507720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c937b-4c3f-4939-bbf7-e4f3400da0fd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:16.514244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1796b-de4d-4adb-8672-4b79a063bed9 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:16.522746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7b63c-4b5a-4ca7-be65-d9952833887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:16.526819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7b63c-4b5a-4ca7-be65-d9952833887a admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:16.527423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7b63c-4b5a-4ca7-be65-d9952833887a admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:16.528893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7b63c-4b5a-4ca7-be65-d9952833887a admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:16.530276 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7b63c-4b5a-4ca7-be65-d9952833887a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:16.532190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7b63c-4b5a-4ca7-be65-d9952833887a admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:16.561461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c937b-4c3f-4939-bbf7-e4f3400da0fd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:16.575693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 897/1775] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:16.578791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116d990-dcb9-42dc-8c3b-62330a8bcdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:16.578791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116d990-dcb9-42dc-8c3b-62330a8bcdaa admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:16.578791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116d990-dcb9-42dc-8c3b-62330a8bcdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:16.578791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116d990-dcb9-42dc-8c3b-62330a8bcdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:16.579110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116d990-dcb9-42dc-8c3b-62330a8bcdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:16.596266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116d990-dcb9-42dc-8c3b-62330a8bcdaa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:16.618345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7b63c-4b5a-4ca7-be65-d9952833887a admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:16.642682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7b63c-4b5a-4ca7-be65-d9952833887a admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:16.662266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d00b6-e5de-4f23-92aa-1341ed24991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:16.663518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d00b6-e5de-4f23-92aa-1341ed24991e admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:16.665398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d00b6-e5de-4f23-92aa-1341ed24991e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:16.666555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d00b6-e5de-4f23-92aa-1341ed24991e admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:16.667589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d00b6-e5de-4f23-92aa-1341ed24991e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:16.672949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 879/1776] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:16.674331 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d00b6-e5de-4f23-92aa-1341ed24991e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:16.685210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116d990-dcb9-42dc-8c3b-62330a8bcdaa admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:16.706547 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 898/1777] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:16.720919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d00b6-e5de-4f23-92aa-1341ed24991e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:16.730534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d21d00b6-e5de-4f23-92aa-1341ed24991e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:16.731936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116d990-dcb9-42dc-8c3b-62330a8bcdaa admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:16.751178 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910009-6fc3-449c-8726-b441e9ebf46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:16.751966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910009-6fc3-449c-8726-b441e9ebf46d admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:16.752352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910009-6fc3-449c-8726-b441e9ebf46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:16.753402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910009-6fc3-449c-8726-b441e9ebf46d admin admin] PATH_INFO: `/v3/projects/93dae080aba9439bb3ef14f465534d74/users/0d7d6a168d214b1d88a3f0b1835923d9/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:16.771900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d00b6-e5de-4f23-92aa-1341ed24991e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:16.786737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910009-6fc3-449c-8726-b441e9ebf46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=93dae080aba9439bb3ef14f465534d74, user_id=0d7d6a168d214b1d88a3f0b1835923d9, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:16.790393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:16.791230 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:16.791496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:16.791783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] PATH_INFO: `/v3/users/a4065a6418ec4e5a9056a81c8bd52c94` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:16.795991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910009-6fc3-449c-8726-b441e9ebf46d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:16.796687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4065a6418ec4e5a9056a81c8bd52c94)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:16.804765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:16.869684 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 880/1778] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:16 2022] PUT /identity/v3/projects/93dae080aba9439bb3ef14f465534d74/users/0d7d6a168d214b1d88a3f0b1835923d9/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:16.872183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910009-6fc3-449c-8726-b441e9ebf46d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:16.990849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4065a6418ec4e5a9056a81c8bd52c94'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:16.994378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4065a6418ec4e5a9056a81c8bd52c94'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:17.016513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4065a6418ec4e5a9056a81c8bd52c94'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:17.048893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4065a6418ec4e5a9056a81c8bd52c94'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:17.052875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-5bbce2e1-d8da-46db-bbfd-9033b5d9d467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4065a6418ec4e5a9056a81c8bd52c94'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:17.113535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 899/1779] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:16 2022] DELETE /identity/v3/users/a4065a6418ec4e5a9056a81c8bd52c94 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:17.115653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e98813-8c55-4940-8e7a-20ab352fa1c2 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:17.116171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e98813-8c55-4940-8e7a-20ab352fa1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:17.122853 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e98813-8c55-4940-8e7a-20ab352fa1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:17.239580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-72e98813-8c55-4940-8e7a-20ab352fa1c2 None None] MFA Rules not processed for user `0d7d6a168d214b1d88a3f0b1835923d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:17.243245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-72e98813-8c55-4940-8e7a-20ab352fa1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:17.253314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:17.313486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910009-6fc3-449c-8726-b441e9ebf46d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:17.543125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6b92d-b422-4497-b060-698f5e923469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:17.543837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6b92d-b422-4497-b060-698f5e923469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:17.544123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6b92d-b422-4497-b060-698f5e923469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:17.544451 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6b92d-b422-4497-b060-698f5e923469 admin admin] PATH_INFO: `/v3/projects/f494bf3fb5d540a6b2e70c2510b49059/users/04837b8b53a644c784feb546749c1749/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:17.560577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 900/1780] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:17.563895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3d2c-c2cc-4daa-a8a1-219d0938f75b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:17.564183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3d2c-c2cc-4daa-a8a1-219d0938f75b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:17.564462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3d2c-c2cc-4daa-a8a1-219d0938f75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:17.598101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6b92d-b422-4497-b060-698f5e923469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f494bf3fb5d540a6b2e70c2510b49059, user_id=04837b8b53a644c784feb546749c1749, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:17.603431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6b92d-b422-4497-b060-698f5e923469 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:17.625904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-b56b3d2c-c2cc-4daa-a8a1-219d0938f75b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:17.629917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b56b3d2c-c2cc-4daa-a8a1-219d0938f75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:17.651768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 881/1781] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:16 2022] PUT /identity/v3/projects/f494bf3fb5d540a6b2e70c2510b49059/users/04837b8b53a644c784feb546749c1749/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:17.656640 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6b92d-b422-4497-b060-698f5e923469 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:17.666190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8dd6b92d-b422-4497-b060-698f5e923469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:17.676642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:17.881253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 901/1782] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:17.886973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4aaf4-c5de-44eb-8d9d-b0497f4f4cdb None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:17.887278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4aaf4-c5de-44eb-8d9d-b0497f4f4cdb None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:17.887765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4aaf4-c5de-44eb-8d9d-b0497f4f4cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:17.943896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6b92d-b422-4497-b060-698f5e923469 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:17.968782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d9c19-dcd6-4be9-ac8d-b9ead710a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:17.970583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d9c19-dcd6-4be9-ac8d-b9ead710a9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:17.972052 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d9c19-dcd6-4be9-ac8d-b9ead710a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:17.972775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d9c19-dcd6-4be9-ac8d-b9ead710a9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:17.977909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d9c19-dcd6-4be9-ac8d-b9ead710a9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:17.983120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d9c19-dcd6-4be9-ac8d-b9ead710a9d3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:18.094835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-32f4aaf4-c5de-44eb-8d9d-b0497f4f4cdb None None] MFA Rules not processed for user `04837b8b53a644c784feb546749c1749`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:18.096106 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-32f4aaf4-c5de-44eb-8d9d-b0497f4f4cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:18.103807 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 882/1783] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:17 2022] POST /identity/v3/projects => generated 387 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:18.104901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d9c19-dcd6-4be9-ac8d-b9ead710a9d3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:18.111176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ec7d9c19-dcd6-4be9-ac8d-b9ead710a9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:18.310171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d9c19-dcd6-4be9-ac8d-b9ead710a9d3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:18.318969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683cf5-7d19-46b8-b8b3-326ec44c6fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:18.319790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683cf5-7d19-46b8-b8b3-326ec44c6fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:18.320406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683cf5-7d19-46b8-b8b3-326ec44c6fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:18.320788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683cf5-7d19-46b8-b8b3-326ec44c6fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:18.348193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:18.351224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 902/1784] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:18.353743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b89ce3-aca5-4371-8a17-72f69e8616e0 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:18.354039 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b89ce3-aca5-4371-8a17-72f69e8616e0 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:18.364948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b89ce3-aca5-4371-8a17-72f69e8616e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:18.403267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683cf5-7d19-46b8-b8b3-326ec44c6fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:18.406109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683cf5-7d19-46b8-b8b3-326ec44c6fa6 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:18.422334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 883/1785] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:18.423557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683cf5-7d19-46b8-b8b3-326ec44c6fa6 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:18.436460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683cf5-7d19-46b8-b8b3-326ec44c6fa6 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:18.442433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2f92b-d0a8-48ae-a06e-3bd39b01bf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:18.443509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2f92b-d0a8-48ae-a06e-3bd39b01bf79 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:18.444189 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2f92b-d0a8-48ae-a06e-3bd39b01bf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:18.444681 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2f92b-d0a8-48ae-a06e-3bd39b01bf79 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:18.446843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2f92b-d0a8-48ae-a06e-3bd39b01bf79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:18.449505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2f92b-d0a8-48ae-a06e-3bd39b01bf79 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:18.494241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-57b89ce3-aca5-4371-8a17-72f69e8616e0 None None] MFA Rules not processed for user `43ccbbf2b2124c28b7f8e5d8e18fe624`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:18.496561 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 884/1786] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:18 2022] POST /identity/v3/users => generated 294 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:18.498052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-57b89ce3-aca5-4371-8a17-72f69e8616e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:18.504533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2f92b-d0a8-48ae-a06e-3bd39b01bf79 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:18.511549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-59f2f92b-d0a8-48ae-a06e-3bd39b01bf79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:18.545821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2f92b-d0a8-48ae-a06e-3bd39b01bf79 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:18.567918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44be77-7f74-4321-819b-f8a2dbdb62e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:18.573323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44be77-7f74-4321-819b-f8a2dbdb62e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:18.574026 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44be77-7f74-4321-819b-f8a2dbdb62e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:18.574798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44be77-7f74-4321-819b-f8a2dbdb62e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:18.576545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44be77-7f74-4321-819b-f8a2dbdb62e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:18.585200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44be77-7f74-4321-819b-f8a2dbdb62e7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:18.643485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 885/1787] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:18 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:18.647457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44be77-7f74-4321-819b-f8a2dbdb62e7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:18.747214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 903/1788] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:18.752490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b89ce3-aca5-4371-8a17-72f69e8616e0 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:18.811797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b89ce3-aca5-4371-8a17-72f69e8616e0 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:19.010570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:19.021334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44be77-7f74-4321-819b-f8a2dbdb62e7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:19.051496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd4687-b14b-40e8-831e-1e6f30dacb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:19.052518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd4687-b14b-40e8-831e-1e6f30dacb2d admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.052808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd4687-b14b-40e8-831e-1e6f30dacb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.053400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd4687-b14b-40e8-831e-1e6f30dacb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.063063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd4687-b14b-40e8-831e-1e6f30dacb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:19.069009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd4687-b14b-40e8-831e-1e6f30dacb2d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:19.163939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba705b3-4a35-4160-9520-ea2565963ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:19.164857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba705b3-4a35-4160-9520-ea2565963ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.165293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba705b3-4a35-4160-9520-ea2565963ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.165726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba705b3-4a35-4160-9520-ea2565963ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.167445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba705b3-4a35-4160-9520-ea2565963ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:19.168412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 886/1789] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:19.169709 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd4687-b14b-40e8-831e-1e6f30dacb2d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:19.171795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba705b3-4a35-4160-9520-ea2565963ac9 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:19.238372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 904/1790] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:18 2022] POST /identity/v3/users => generated 299 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:19.243887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba705b3-4a35-4160-9520-ea2565963ac9 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:19.246380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd4687-b14b-40e8-831e-1e6f30dacb2d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:19.273983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba705b3-4a35-4160-9520-ea2565963ac9 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:19.279623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3012b-fda0-458f-bab8-eae8120a46a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:19.282483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3012b-fda0-458f-bab8-eae8120a46a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.285545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3012b-fda0-458f-bab8-eae8120a46a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.290104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3994c4-2751-4ad8-9480-1aaf851ac1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:19.290590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3012b-fda0-458f-bab8-eae8120a46a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.291559 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3012b-fda0-458f-bab8-eae8120a46a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:19.293340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3994c4-2751-4ad8-9480-1aaf851ac1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.293920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3994c4-2751-4ad8-9480-1aaf851ac1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.294350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3994c4-2751-4ad8-9480-1aaf851ac1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.296100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3994c4-2751-4ad8-9480-1aaf851ac1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:19.301377 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3012b-fda0-458f-bab8-eae8120a46a9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:19.302066 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3994c4-2751-4ad8-9480-1aaf851ac1e1 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:19.352522 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 887/1791] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:19.354251 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3012b-fda0-458f-bab8-eae8120a46a9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:19.358239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 905/1792] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:19.359919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3994c4-2751-4ad8-9480-1aaf851ac1e1 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:19.392955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3012b-fda0-458f-bab8-eae8120a46a9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:19.408116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3994c4-2751-4ad8-9480-1aaf851ac1e1 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:19.419177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb90ca-a209-4500-8b8e-c1caa8c2da98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:19.420130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb90ca-a209-4500-8b8e-c1caa8c2da98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.420558 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb90ca-a209-4500-8b8e-c1caa8c2da98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.420997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb90ca-a209-4500-8b8e-c1caa8c2da98 admin admin] PATH_INFO: `/v3/projects/510089168baf403eb79102bfce717d58/users/e69bbf5976704384aa14f218c3aa41ac/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.463787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc6793-5a17-40f3-bf8b-8d8690a62b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:19.465574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc6793-5a17-40f3-bf8b-8d8690a62b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.468804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc6793-5a17-40f3-bf8b-8d8690a62b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.469317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc6793-5a17-40f3-bf8b-8d8690a62b2e admin admin] PATH_INFO: `/v3/projects/6546534cb722478aaeb0b94af07d8554/users/36e1f0b1a33b4d4ba767e088dc6bdc4d/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.479339 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb90ca-a209-4500-8b8e-c1caa8c2da98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510089168baf403eb79102bfce717d58, user_id=e69bbf5976704384aa14f218c3aa41ac, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:19.495239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb90ca-a209-4500-8b8e-c1caa8c2da98 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:19.558575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 888/1793] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:19 2022] PUT /identity/v3/projects/510089168baf403eb79102bfce717d58/users/e69bbf5976704384aa14f218c3aa41ac/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:19.560363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35381589-ccea-4c84-a29c-4162bbb370de None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.560748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35381589-ccea-4c84-a29c-4162bbb370de None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.561138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35381589-ccea-4c84-a29c-4162bbb370de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.562006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc6793-5a17-40f3-bf8b-8d8690a62b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6546534cb722478aaeb0b94af07d8554, user_id=36e1f0b1a33b4d4ba767e088dc6bdc4d, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:19.566916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc6793-5a17-40f3-bf8b-8d8690a62b2e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:19.605521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 906/1794] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:19 2022] PUT /identity/v3/projects/6546534cb722478aaeb0b94af07d8554/users/36e1f0b1a33b4d4ba767e088dc6bdc4d/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:19.607038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc6793-5a17-40f3-bf8b-8d8690a62b2e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:19.611413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-35381589-ccea-4c84-a29c-4162bbb370de None None] MFA Rules not processed for user `e69bbf5976704384aa14f218c3aa41ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:19.614296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-35381589-ccea-4c84-a29c-4162bbb370de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:19.763378 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:19.813055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc6793-5a17-40f3-bf8b-8d8690a62b2e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:19.849295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd23c0-4299-4772-9fd7-b6cc4f56babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:19.855153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd23c0-4299-4772-9fd7-b6cc4f56babe admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.856519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd23c0-4299-4772-9fd7-b6cc4f56babe admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.857962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd23c0-4299-4772-9fd7-b6cc4f56babe admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.868136 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd23c0-4299-4772-9fd7-b6cc4f56babe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:19.870622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd23c0-4299-4772-9fd7-b6cc4f56babe admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:19.919797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 907/1795] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:19.921360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 889/1796] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:19.922398 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35381589-ccea-4c84-a29c-4162bbb370de None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:19.924320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892c44-48f0-40ce-8f29-2e7982bbad92 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.924608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892c44-48f0-40ce-8f29-2e7982bbad92 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.924883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892c44-48f0-40ce-8f29-2e7982bbad92 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.929329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 908/1797] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:09:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:09:19.930404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4892c44-48f0-40ce-8f29-2e7982bbad92 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:19.943415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35381589-ccea-4c84-a29c-4162bbb370de None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:19.949767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bfaa7-b14b-480b-8639-6c79cb1afcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:19.950877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bfaa7-b14b-480b-8639-6c79cb1afcfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.952430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bfaa7-b14b-480b-8639-6c79cb1afcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.953770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bfaa7-b14b-480b-8639-6c79cb1afcfc admin admin] PATH_INFO: `/v3/projects/6546534cb722478aaeb0b94af07d8554/users/36e1f0b1a33b4d4ba767e088dc6bdc4d/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.962499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bfaa7-b14b-480b-8639-6c79cb1afcfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6546534cb722478aaeb0b94af07d8554, user_id=36e1f0b1a33b4d4ba767e088dc6bdc4d, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:19.970357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bfaa7-b14b-480b-8639-6c79cb1afcfc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:19.971315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4892c44-48f0-40ce-8f29-2e7982bbad92 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:19.986828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256eb63-eeba-45bc-9aaf-0deb3bc58aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:19.987332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256eb63-eeba-45bc-9aaf-0deb3bc58aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:19.987604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256eb63-eeba-45bc-9aaf-0deb3bc58aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:19.987877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256eb63-eeba-45bc-9aaf-0deb3bc58aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:19.988571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256eb63-eeba-45bc-9aaf-0deb3bc58aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:19.994661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256eb63-eeba-45bc-9aaf-0deb3bc58aaa admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:20.013771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 890/1798] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:19 2022] PUT /identity/v3/projects/6546534cb722478aaeb0b94af07d8554/users/36e1f0b1a33b4d4ba767e088dc6bdc4d/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:20.033086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bddf1-f0df-4022-af61-8f88960cf450 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:20.034143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bddf1-f0df-4022-af61-8f88960cf450 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:20.034474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bddf1-f0df-4022-af61-8f88960cf450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:20.064056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 909/1799] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:19 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:20.065864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5879c-6029-48ec-ae5b-97d9a4e9f4c6 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:20.066287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5879c-6029-48ec-ae5b-97d9a4e9f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:20.067736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5879c-6029-48ec-ae5b-97d9a4e9f4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:20.104514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b63bddf1-f0df-4022-af61-8f88960cf450 None None] MFA Rules not processed for user `36e1f0b1a33b4d4ba767e088dc6bdc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:20.106279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b63bddf1-f0df-4022-af61-8f88960cf450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:20.174816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-24d5879c-6029-48ec-ae5b-97d9a4e9f4c6 None None] MFA Rules not processed for user `c88a4ae446ac43b48ee778344caec88c`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:20.178326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-24d5879c-6029-48ec-ae5b-97d9a4e9f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:20.408006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 910/1800] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:20.409235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 891/1801] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:20.410418 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bddf1-f0df-4022-af61-8f88960cf450 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:20.414796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a02474-42bd-4dc2-a8e7-c2c7ab4180d4 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:20.415110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a02474-42bd-4dc2-a8e7-c2c7ab4180d4 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:20.418376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a02474-42bd-4dc2-a8e7-c2c7ab4180d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:20.498139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:20.528837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-b2a02474-42bd-4dc2-a8e7-c2c7ab4180d4 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:20.531602 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b2a02474-42bd-4dc2-a8e7-c2c7ab4180d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:20.715437 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bddf1-f0df-4022-af61-8f88960cf450 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:20.732372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fa0c7-589d-4102-91f2-512f0f78b1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:20.733266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fa0c7-589d-4102-91f2-512f0f78b1dc admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:20.733457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fa0c7-589d-4102-91f2-512f0f78b1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:20.733736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fa0c7-589d-4102-91f2-512f0f78b1dc admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:20.734373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fa0c7-589d-4102-91f2-512f0f78b1dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:20.736661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fa0c7-589d-4102-91f2-512f0f78b1dc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:20.796573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 892/1802] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:20 2022] POST /identity/v3/users => generated 300 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:20.799381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fa0c7-589d-4102-91f2-512f0f78b1dc admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:20.805197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-158fa0c7-589d-4102-91f2-512f0f78b1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:20.821404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 911/1803] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:09:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:20.822931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a02474-42bd-4dc2-a8e7-c2c7ab4180d4 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:20.870864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a02474-42bd-4dc2-a8e7-c2c7ab4180d4 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:20.890473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a11ca9-b823-4fb4-b341-fc82687e0e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:20.891125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a11ca9-b823-4fb4-b341-fc82687e0e67 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:20.894399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a11ca9-b823-4fb4-b341-fc82687e0e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:20.894751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a11ca9-b823-4fb4-b341-fc82687e0e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:20.897041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a11ca9-b823-4fb4-b341-fc82687e0e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:20.901409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:20.916179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a11ca9-b823-4fb4-b341-fc82687e0e67 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:20.956274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 912/1804] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:20.957118 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a11ca9-b823-4fb4-b341-fc82687e0e67 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:20.968774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a11ca9-b823-4fb4-b341-fc82687e0e67 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:20.980973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94939cf-e9fe-4209-b346-6347a390768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:20.983756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94939cf-e9fe-4209-b346-6347a390768a admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:20.984051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94939cf-e9fe-4209-b346-6347a390768a admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:20.984183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fa0c7-589d-4102-91f2-512f0f78b1dc admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:20.984811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94939cf-e9fe-4209-b346-6347a390768a admin admin] PATH_INFO: `/v3/projects/2a4314e8026f4b9882c697eeb1bc1a43/users/455ed2d90f4f4e0fa2417052b6dd4449/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:20.999519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effde5c-cf2e-4b4e-b88f-48e76d32bf3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:20.999519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effde5c-cf2e-4b4e-b88f-48e76d32bf3f service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:20.999842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effde5c-cf2e-4b4e-b88f-48e76d32bf3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:20.999922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effde5c-cf2e-4b4e-b88f-48e76d32bf3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:21.030847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94939cf-e9fe-4209-b346-6347a390768a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4314e8026f4b9882c697eeb1bc1a43, user_id=455ed2d90f4f4e0fa2417052b6dd4449, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:21.033460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effde5c-cf2e-4b4e-b88f-48e76d32bf3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:21.033588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94939cf-e9fe-4209-b346-6347a390768a admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:21.036437 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effde5c-cf2e-4b4e-b88f-48e76d32bf3f service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:21.073631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 893/1806] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:21.076054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effde5c-cf2e-4b4e-b88f-48e76d32bf3f service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:21.087882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 913/1806] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:20 2022] PUT /identity/v3/projects/2a4314e8026f4b9882c697eeb1bc1a43/users/455ed2d90f4f4e0fa2417052b6dd4449/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:21.113545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effde5c-cf2e-4b4e-b88f-48e76d32bf3f service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:21.340804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6704d7-29c9-46f2-b79a-5ea2c1172c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:21.344457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6704d7-29c9-46f2-b79a-5ea2c1172c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:21.346078 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6704d7-29c9-46f2-b79a-5ea2c1172c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:21.349000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6704d7-29c9-46f2-b79a-5ea2c1172c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:21.354863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6704d7-29c9-46f2-b79a-5ea2c1172c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:21.364962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6704d7-29c9-46f2-b79a-5ea2c1172c68 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:21.397956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 894/1807] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:21.403293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94939cf-e9fe-4209-b346-6347a390768a admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:21.441059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94939cf-e9fe-4209-b346-6347a390768a admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:21.452558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb8d6-6c0c-40bd-884d-f389f8606c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:21.453256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb8d6-6c0c-40bd-884d-f389f8606c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:21.453580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb8d6-6c0c-40bd-884d-f389f8606c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:21.453818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb8d6-6c0c-40bd-884d-f389f8606c0f admin admin] PATH_INFO: `/v3/projects/2a4314e8026f4b9882c697eeb1bc1a43/users/455ed2d90f4f4e0fa2417052b6dd4449/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:21.461910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb8d6-6c0c-40bd-884d-f389f8606c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4314e8026f4b9882c697eeb1bc1a43, user_id=455ed2d90f4f4e0fa2417052b6dd4449, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:21.485284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb8d6-6c0c-40bd-884d-f389f8606c0f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:21.523507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 914/1808] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:21 2022] PUT /identity/v3/projects/2a4314e8026f4b9882c697eeb1bc1a43/users/455ed2d90f4f4e0fa2417052b6dd4449/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:21.534269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475aa0e-f39c-4bdd-b5cd-daf62b473192 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:21.534881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475aa0e-f39c-4bdd-b5cd-daf62b473192 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:21.535473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475aa0e-f39c-4bdd-b5cd-daf62b473192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:21.624275 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2475aa0e-f39c-4bdd-b5cd-daf62b473192 None None] MFA Rules not processed for user `455ed2d90f4f4e0fa2417052b6dd4449`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:21.625650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2475aa0e-f39c-4bdd-b5cd-daf62b473192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:21.671512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb8d6-6c0c-40bd-884d-f389f8606c0f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:21.673567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-440fb8d6-6c0c-40bd-884d-f389f8606c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:21.929053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb8d6-6c0c-40bd-884d-f389f8606c0f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:21.944636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:21.945345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:21.945631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:21.945907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] PATH_INFO: `/v3/projects/02dc9233c1d24add9310341724778669` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:21.962413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=02dc9233c1d24add9310341724778669)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:21.964434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:21.992153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 895/1809] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:21.993217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475aa0e-f39c-4bdd-b5cd-daf62b473192 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:22.000849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2475aa0e-f39c-4bdd-b5cd-daf62b473192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:22.210504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02dc9233c1d24add9310341724778669', 'request_id': 'req-c968d4b1-6917-49e2-9a20-235a69a639bc'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:22.213850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:22.231100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02dc9233c1d24add9310341724778669', 'request_id': 'req-c968d4b1-6917-49e2-9a20-235a69a639bc'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:22.245665 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02dc9233c1d24add9310341724778669', 'request_id': 'req-c968d4b1-6917-49e2-9a20-235a69a639bc'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:22.282305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:22.292599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] The token cache is being invalidate because project 02dc9233c1d24add9310341724778669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:22.294259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:22.295686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:22.300186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 915/1810] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:21 2022] DELETE /identity/v3/projects/02dc9233c1d24add9310341724778669 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:22.301351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:22.323831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:22.401825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475aa0e-f39c-4bdd-b5cd-daf62b473192 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:22.549950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968d4b1-6917-49e2-9a20-235a69a639bc admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:22.554973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9a571-444c-4f3e-be4e-aedadd0ee7e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:22.555610 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a571-444c-4f3e-be4e-aedadd0ee7e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:22.555897 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a571-444c-4f3e-be4e-aedadd0ee7e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:22.556174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a571-444c-4f3e-be4e-aedadd0ee7e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:22.559567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8dd9a571-444c-4f3e-be4e-aedadd0ee7e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:22.713647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9a571-444c-4f3e-be4e-aedadd0ee7e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:22.716009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9a571-444c-4f3e-be4e-aedadd0ee7e2 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:22.723626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f1618-fc58-4535-951f-c1b271434d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:22.730284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 916/1811] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:22.732281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fdd46-9ead-4d63-8605-a6480f763741 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:22.732888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fdd46-9ead-4d63-8605-a6480f763741 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:22.733265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fdd46-9ead-4d63-8605-a6480f763741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:22.733462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f1618-fc58-4535-951f-c1b271434d31 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:22.733827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f1618-fc58-4535-951f-c1b271434d31 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:22.734117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f1618-fc58-4535-951f-c1b271434d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:22.746529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c11f1618-fc58-4535-951f-c1b271434d31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:22.764691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-082fdd46-9ead-4d63-8605-a6480f763741 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:22.766300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-082fdd46-9ead-4d63-8605-a6480f763741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:22.805580 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f1618-fc58-4535-951f-c1b271434d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:22.808043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f1618-fc58-4535-951f-c1b271434d31 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:22.891060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 896/1812] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 898 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:22.903955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f1618-fc58-4535-951f-c1b271434d31 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:22.914124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c11f1618-fc58-4535-951f-c1b271434d31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:23.006132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 917/1813] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:23.009394 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc562b2-b12e-4d8f-9c4e-3c4100e24803 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:23.009682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc562b2-b12e-4d8f-9c4e-3c4100e24803 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:23.009956 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc562b2-b12e-4d8f-9c4e-3c4100e24803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:23.135282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-7cc562b2-b12e-4d8f-9c4e-3c4100e24803 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:23.144439 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7cc562b2-b12e-4d8f-9c4e-3c4100e24803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:23.185029 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 918/1814] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:23.195705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc562b2-b12e-4d8f-9c4e-3c4100e24803 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:23.202201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f1618-fc58-4535-951f-c1b271434d31 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:23.219303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:23.220391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:23.220933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:23.221379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] PATH_INFO: `/v3/users/04837b8b53a644c784feb546749c1749` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:23.224485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04837b8b53a644c784feb546749c1749)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:23.233013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc562b2-b12e-4d8f-9c4e-3c4100e24803 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:23.236804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:23.239918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c8c5f-c9f6-4650-989e-afbcd3e4ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:23.241119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c8c5f-c9f6-4650-989e-afbcd3e4ccd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:23.241606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c8c5f-c9f6-4650-989e-afbcd3e4ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:23.242805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c8c5f-c9f6-4650-989e-afbcd3e4ccd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:23.243785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c8c5f-c9f6-4650-989e-afbcd3e4ccd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:23.244213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c8c5f-c9f6-4650-989e-afbcd3e4ccd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:23.246480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c8c5f-c9f6-4650-989e-afbcd3e4ccd2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:23.277994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 919/1815] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 02:09:23.279603 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c8c5f-c9f6-4650-989e-afbcd3e4ccd2 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:23.297970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c8c5f-c9f6-4650-989e-afbcd3e4ccd2 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:23.347649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde8e5a-4167-4ba8-86c1-1bd54970fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:23.349263 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde8e5a-4167-4ba8-86c1-1bd54970fd56 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:23.351822 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde8e5a-4167-4ba8-86c1-1bd54970fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:23.355080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde8e5a-4167-4ba8-86c1-1bd54970fd56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:23.357955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde8e5a-4167-4ba8-86c1-1bd54970fd56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:23.363745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde8e5a-4167-4ba8-86c1-1bd54970fd56 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:23.386575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:23.395365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04837b8b53a644c784feb546749c1749'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:23.397905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04837b8b53a644c784feb546749c1749'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:23.422943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04837b8b53a644c784feb546749c1749'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:23.434044 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 920/1816] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:23 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:23.435463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde8e5a-4167-4ba8-86c1-1bd54970fd56 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:23.483947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04837b8b53a644c784feb546749c1749'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:23.487213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f33e02f7-ecb6-48aa-b868-f4141e5b51d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04837b8b53a644c784feb546749c1749'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:23.515779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:23.527858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 897/1817] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:22 2022] DELETE /identity/v3/users/04837b8b53a644c784feb546749c1749 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:23.533850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92406154-f6a9-4fea-8062-033ab1ba9ba1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:23.535256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92406154-f6a9-4fea-8062-033ab1ba9ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:23.537843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92406154-f6a9-4fea-8062-033ab1ba9ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:23.575465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde8e5a-4167-4ba8-86c1-1bd54970fd56 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:23.582352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-92406154-f6a9-4fea-8062-033ab1ba9ba1 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:23.587482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-92406154-f6a9-4fea-8062-033ab1ba9ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:23.711943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3afc6f-f1b5-4e04-a166-a59906a7fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:23.712657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3afc6f-f1b5-4e04-a166-a59906a7fe39 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:23.713018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3afc6f-f1b5-4e04-a166-a59906a7fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:23.713302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3afc6f-f1b5-4e04-a166-a59906a7fe39 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:23.714099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3afc6f-f1b5-4e04-a166-a59906a7fe39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:23.720281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3afc6f-f1b5-4e04-a166-a59906a7fe39 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:23.793335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 921/1818] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:23 2022] POST /identity/v3/users => generated 290 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:23.800576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755d75-8a68-40cb-99fa-4457b737ec00 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:23.811391 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755d75-8a68-40cb-99fa-4457b737ec00 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:23.811976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755d75-8a68-40cb-99fa-4457b737ec00 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:23.819488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 922/1819] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:09:23 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:09:23.821637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 898/1820] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:23.826242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755d75-8a68-40cb-99fa-4457b737ec00 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:23.833267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4b755d75-8a68-40cb-99fa-4457b737ec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:23.882116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92406154-f6a9-4fea-8062-033ab1ba9ba1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:23.884170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-92406154-f6a9-4fea-8062-033ab1ba9ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:23.896394 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755d75-8a68-40cb-99fa-4457b737ec00 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:23.937292 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6ba2a-eaa5-4661-8aa6-a098f8bd60d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:23.959814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ba2a-eaa5-4661-8aa6-a098f8bd60d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:23.961816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ba2a-eaa5-4661-8aa6-a098f8bd60d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:23.963969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ba2a-eaa5-4661-8aa6-a098f8bd60d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:23.967462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6ba2a-eaa5-4661-8aa6-a098f8bd60d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:23.973427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6ba2a-eaa5-4661-8aa6-a098f8bd60d6 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:24.032883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 923/1821] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:24.036861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6beba-859f-45b3-862b-8fa74a5bf460 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:24.043087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6beba-859f-45b3-862b-8fa74a5bf460 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:24.045796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6beba-859f-45b3-862b-8fa74a5bf460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:24.048509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92406154-f6a9-4fea-8062-033ab1ba9ba1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:24.066852 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13869d31-3e73-4b9e-b1a9-db3e2a388abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:24.067503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13869d31-3e73-4b9e-b1a9-db3e2a388abc service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:24.067875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13869d31-3e73-4b9e-b1a9-db3e2a388abc service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:24.068226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13869d31-3e73-4b9e-b1a9-db3e2a388abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:24.096425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13869d31-3e73-4b9e-b1a9-db3e2a388abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:24.096831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-7da6beba-859f-45b3-862b-8fa74a5bf460 None None] MFA Rules not processed for user `e041d38c69cd4626898bc1412f5ed1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:24.097910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13869d31-3e73-4b9e-b1a9-db3e2a388abc service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:24.099259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7da6beba-859f-45b3-862b-8fa74a5bf460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:24.122583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 899/1822] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:24.123550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13869d31-3e73-4b9e-b1a9-db3e2a388abc service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:24.149329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13869d31-3e73-4b9e-b1a9-db3e2a388abc service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:24.186932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50985b3-858b-4b50-a8b1-e9aa7c891fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:24.195812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50985b3-858b-4b50-a8b1-e9aa7c891fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:24.196184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50985b3-858b-4b50-a8b1-e9aa7c891fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:24.196537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50985b3-858b-4b50-a8b1-e9aa7c891fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:24.197497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50985b3-858b-4b50-a8b1-e9aa7c891fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:24.199514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50985b3-858b-4b50-a8b1-e9aa7c891fd7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:24.250699 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 900/1823] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:24.251715 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50985b3-858b-4b50-a8b1-e9aa7c891fd7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:24.272277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50985b3-858b-4b50-a8b1-e9aa7c891fd7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:24.292112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 924/1824] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:09:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:24.294417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc9a41-8076-44cb-b1c4-18a0fcff3e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:24.295284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9a41-8076-44cb-b1c4-18a0fcff3e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:24.295571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9a41-8076-44cb-b1c4-18a0fcff3e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:24.295852 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9a41-8076-44cb-b1c4-18a0fcff3e82 admin admin] PATH_INFO: `/v3/projects/118b600874874069947732ab500ff011/users/fcd1e4a0b3ba49b89efe1bb02046a14f/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:24.354136 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6beba-859f-45b3-862b-8fa74a5bf460 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:24.355856 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7da6beba-859f-45b3-862b-8fa74a5bf460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:24.360092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc9a41-8076-44cb-b1c4-18a0fcff3e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118b600874874069947732ab500ff011, user_id=fcd1e4a0b3ba49b89efe1bb02046a14f, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:24.363153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc9a41-8076-44cb-b1c4-18a0fcff3e82 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:24.395593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 901/1825] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:24 2022] PUT /identity/v3/projects/118b600874874069947732ab500ff011/users/fcd1e4a0b3ba49b89efe1bb02046a14f/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:24.408496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348552c7-bbca-4a06-8de7-9c322930cc4d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:24.408831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348552c7-bbca-4a06-8de7-9c322930cc4d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:24.409110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348552c7-bbca-4a06-8de7-9c322930cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:24.422872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:24.488688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-348552c7-bbca-4a06-8de7-9c322930cc4d None None] MFA Rules not processed for user `fcd1e4a0b3ba49b89efe1bb02046a14f`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:24.490418 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-348552c7-bbca-4a06-8de7-9c322930cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:24.676651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:24.698646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6beba-859f-45b3-862b-8fa74a5bf460 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:24.713196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 902/1826] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:24.714929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348552c7-bbca-4a06-8de7-9c322930cc4d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:24.887919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1ecd-fd99-4e15-a630-14af2d7ef6fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:24.888665 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1ecd-fd99-4e15-a630-14af2d7ef6fe service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:24.890058 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1ecd-fd99-4e15-a630-14af2d7ef6fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:24.892120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1ecd-fd99-4e15-a630-14af2d7ef6fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:24.897635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9fbd1ecd-fd99-4e15-a630-14af2d7ef6fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:24.949712 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348552c7-bbca-4a06-8de7-9c322930cc4d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:24.969234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487d0a7-ea27-4c02-bf3b-6c60c191f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:24.970520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d0a7-ea27-4c02-bf3b-6c60c191f791 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:24.971262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d0a7-ea27-4c02-bf3b-6c60c191f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:24.971756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d0a7-ea27-4c02-bf3b-6c60c191f791 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:24.972655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487d0a7-ea27-4c02-bf3b-6c60c191f791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:24.974963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487d0a7-ea27-4c02-bf3b-6c60c191f791 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:25.094757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 903/1827] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:24 2022] POST /identity/v3/projects => generated 381 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:25.096481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487d0a7-ea27-4c02-bf3b-6c60c191f791 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:25.121973 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a487d0a7-ea27-4c02-bf3b-6c60c191f791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:25.175361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1ecd-fd99-4e15-a630-14af2d7ef6fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:25.176879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1ecd-fd99-4e15-a630-14af2d7ef6fe service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:25.218538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 925/1828] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 863 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:09:25.221860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1ecd-fd99-4e15-a630-14af2d7ef6fe service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:25.270321 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1ecd-fd99-4e15-a630-14af2d7ef6fe service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:25.409118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487d0a7-ea27-4c02-bf3b-6c60c191f791 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:25.425865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4801f-c421-4a01-9241-40d5edf352c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:25.426851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4801f-c421-4a01-9241-40d5edf352c3 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:25.427225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4801f-c421-4a01-9241-40d5edf352c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:25.428785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4801f-c421-4a01-9241-40d5edf352c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:25.463316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4801f-c421-4a01-9241-40d5edf352c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:25.465108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4801f-c421-4a01-9241-40d5edf352c3 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:25.471651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90438cd2-e0b2-4d37-b189-e2b48baa52ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:25.472296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90438cd2-e0b2-4d37-b189-e2b48baa52ee admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:25.472587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90438cd2-e0b2-4d37-b189-e2b48baa52ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:25.472864 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90438cd2-e0b2-4d37-b189-e2b48baa52ee admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:25.473546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90438cd2-e0b2-4d37-b189-e2b48baa52ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:25.485180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90438cd2-e0b2-4d37-b189-e2b48baa52ee admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:25.499325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 904/1829] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:25.574797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 926/1830] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:25 2022] POST /identity/v3/users => generated 297 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:25.575430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4801f-c421-4a01-9241-40d5edf352c3 service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:25.656910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4801f-c421-4a01-9241-40d5edf352c3 service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:25.680630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a897861-e572-421c-a2a0-7310a0b93ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:25.684132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a897861-e572-421c-a2a0-7310a0b93ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:25.684132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a897861-e572-421c-a2a0-7310a0b93ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:25.684132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a897861-e572-421c-a2a0-7310a0b93ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:25.690322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a897861-e572-421c-a2a0-7310a0b93ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:25.699880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a897861-e572-421c-a2a0-7310a0b93ec3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:25.736871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 905/1831] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:25.740973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90438cd2-e0b2-4d37-b189-e2b48baa52ee admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:25.753894 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90438cd2-e0b2-4d37-b189-e2b48baa52ee admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:25.781199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593651b6-0220-4698-80c5-356959a917f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:25.781903 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593651b6-0220-4698-80c5-356959a917f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:25.782188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593651b6-0220-4698-80c5-356959a917f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:25.789249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593651b6-0220-4698-80c5-356959a917f5 admin admin] PATH_INFO: `/v3/projects/e4083fb8ec8041249362fabf3d9b884f/users/316e4289c88d43839f24c5efb9590498/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:25.831079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:25.885768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593651b6-0220-4698-80c5-356959a917f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4083fb8ec8041249362fabf3d9b884f, user_id=316e4289c88d43839f24c5efb9590498, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:25.894390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593651b6-0220-4698-80c5-356959a917f5 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:25.930747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 927/1832] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:25 2022] PUT /identity/v3/projects/e4083fb8ec8041249362fabf3d9b884f/users/316e4289c88d43839f24c5efb9590498/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:25.932259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a897861-e572-421c-a2a0-7310a0b93ec3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:25.953453 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a897861-e572-421c-a2a0-7310a0b93ec3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:26.148048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e536e0-9586-4f3f-be0b-1dc0782194b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:26.149616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e536e0-9586-4f3f-be0b-1dc0782194b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:26.150248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e536e0-9586-4f3f-be0b-1dc0782194b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:26.150893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e536e0-9586-4f3f-be0b-1dc0782194b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:26.151770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e536e0-9586-4f3f-be0b-1dc0782194b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:26.153985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e536e0-9586-4f3f-be0b-1dc0782194b2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:26.155857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:26.182638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593651b6-0220-4698-80c5-356959a917f5 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:26.198130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 906/1833] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:26.201005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593651b6-0220-4698-80c5-356959a917f5 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:26.209836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819afa7-bb65-455e-82ec-52d9422b0fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:26.211719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819afa7-bb65-455e-82ec-52d9422b0fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:26.212942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819afa7-bb65-455e-82ec-52d9422b0fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:26.213809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819afa7-bb65-455e-82ec-52d9422b0fc7 admin admin] PATH_INFO: `/v3/projects/e4083fb8ec8041249362fabf3d9b884f/users/316e4289c88d43839f24c5efb9590498/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:26.216655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819afa7-bb65-455e-82ec-52d9422b0fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4083fb8ec8041249362fabf3d9b884f, user_id=316e4289c88d43839f24c5efb9590498, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:26.220834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819afa7-bb65-455e-82ec-52d9422b0fc7 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:26.284283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02011de-2f43-4a6a-ad3d-3eb9f92362f0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:26.284994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02011de-2f43-4a6a-ad3d-3eb9f92362f0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:26.285797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02011de-2f43-4a6a-ad3d-3eb9f92362f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:26.292922 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 928/1834] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:26 2022] PUT /identity/v3/projects/e4083fb8ec8041249362fabf3d9b884f/users/316e4289c88d43839f24c5efb9590498/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:26.370062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b02011de-2f43-4a6a-ad3d-3eb9f92362f0 None None] MFA Rules not processed for user `316e4289c88d43839f24c5efb9590498`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:26.372709 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b02011de-2f43-4a6a-ad3d-3eb9f92362f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:26.553506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 907/1835] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:26.567570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819afa7-bb65-455e-82ec-52d9422b0fc7 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:26.704189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819afa7-bb65-455e-82ec-52d9422b0fc7 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:26.708913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0240-6465-45f0-ad4a-ac0d5586e56a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:26.709614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0240-6465-45f0-ad4a-ac0d5586e56a service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:26.709902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0240-6465-45f0-ad4a-ac0d5586e56a service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:26.710183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0240-6465-45f0-ad4a-ac0d5586e56a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:26.722393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf0240-6465-45f0-ad4a-ac0d5586e56a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:26.723865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf0240-6465-45f0-ad4a-ac0d5586e56a service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:26.734416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 929/1836] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:26.841660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02011de-2f43-4a6a-ad3d-3eb9f92362f0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:26.865149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02011de-2f43-4a6a-ad3d-3eb9f92362f0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:26.869792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468471d-20f1-4af6-af6f-e571b72861ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:26.870357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468471d-20f1-4af6-af6f-e571b72861ab service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:26.870787 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468471d-20f1-4af6-af6f-e571b72861ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:26.871298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468471d-20f1-4af6-af6f-e571b72861ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:27.006147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468471d-20f1-4af6-af6f-e571b72861ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:27.008467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468471d-20f1-4af6-af6f-e571b72861ab service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:27.030982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 908/1837] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:27.522236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0240-6465-45f0-ad4a-ac0d5586e56a service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:27.524134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fddf0240-6465-45f0-ad4a-ac0d5586e56a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:27.631638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0240-6465-45f0-ad4a-ac0d5586e56a service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:27.637089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:27.637964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:27.638248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:27.638556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] PATH_INFO: `/v3/users/c9e07818a8c54e318bd521ae4710bcd3` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:27.650690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e07818a8c54e318bd521ae4710bcd3)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:27.654039 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:27.730530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e07818a8c54e318bd521ae4710bcd3'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:27.731470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e07818a8c54e318bd521ae4710bcd3'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:27.744930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e07818a8c54e318bd521ae4710bcd3'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:27.763846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e07818a8c54e318bd521ae4710bcd3'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:27.764688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e07818a8c54e318bd521ae4710bcd3'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:27.772627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:27.782858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 930/1838] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:27 2022] DELETE /identity/v3/users/c9e07818a8c54e318bd521ae4710bcd3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:27.875241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468471d-20f1-4af6-af6f-e571b72861ab service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:27.877211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f468471d-20f1-4af6-af6f-e571b72861ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:27.895436 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468471d-20f1-4af6-af6f-e571b72861ab service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:27.987941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:27.988667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:27.989051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:27.989411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] PATH_INFO: `/v3/projects/f494bf3fb5d540a6b2e70c2510b49059` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:27.990645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f494bf3fb5d540a6b2e70c2510b49059)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:27.993033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:28.032630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:28.056062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:28.057991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:28.086532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c019af-2868-41b8-a619-07f178edaa03 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:28.086741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f494bf3fb5d540a6b2e70c2510b49059', 'request_id': 'req-979669ab-6e48-406e-85c7-ae0dfb32d7b2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.103747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f494bf3fb5d540a6b2e70c2510b49059', 'request_id': 'req-979669ab-6e48-406e-85c7-ae0dfb32d7b2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.111727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f494bf3fb5d540a6b2e70c2510b49059', 'request_id': 'req-979669ab-6e48-406e-85c7-ae0dfb32d7b2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.138399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] The token cache is being invalidate because project f494bf3fb5d540a6b2e70c2510b49059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:28.138759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.139489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.141319 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 909/1839] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:27 2022] DELETE /identity/v3/projects/f494bf3fb5d540a6b2e70c2510b49059 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:28.146178 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:28.150636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:28.193463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:28.194523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:28.195485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:28.195926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] PATH_INFO: `/v3/projects/79ef69a63ace4c3caac3aa9c164f1452` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:28.197450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ef69a63ace4c3caac3aa9c164f1452)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:28.214684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:28.252966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979669ab-6e48-406e-85c7-ae0dfb32d7b2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:28.261469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:28.262500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:28.262982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:28.263540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] PATH_INFO: `/v3/users/36e1f0b1a33b4d4ba767e088dc6bdc4d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:28.266456 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e1f0b1a33b4d4ba767e088dc6bdc4d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:28.268947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:28.292408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ef69a63ace4c3caac3aa9c164f1452', 'request_id': 'req-9947ac6b-db76-4698-8402-310510d0b962'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.302421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ef69a63ace4c3caac3aa9c164f1452', 'request_id': 'req-9947ac6b-db76-4698-8402-310510d0b962'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.309697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ef69a63ace4c3caac3aa9c164f1452', 'request_id': 'req-9947ac6b-db76-4698-8402-310510d0b962'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.326900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] The token cache is being invalidate because project 79ef69a63ace4c3caac3aa9c164f1452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:28.327461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.328019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.330478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 931/1840] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:28 2022] DELETE /identity/v3/projects/79ef69a63ace4c3caac3aa9c164f1452 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:28.333458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e1f0b1a33b4d4ba767e088dc6bdc4d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.333796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:28.334310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e1f0b1a33b4d4ba767e088dc6bdc4d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.336848 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:28.348082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e1f0b1a33b4d4ba767e088dc6bdc4d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.368564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e1f0b1a33b4d4ba767e088dc6bdc4d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.384048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e1f0b1a33b4d4ba767e088dc6bdc4d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.409116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 910/1841] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:28 2022] DELETE /identity/v3/users/36e1f0b1a33b4d4ba767e088dc6bdc4d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:28.435122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947ac6b-db76-4698-8402-310510d0b962 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:28.499872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:28.537218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:28.537882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:28.538076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:28.539030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] PATH_INFO: `/v3/users/43ccbbf2b2124c28b7f8e5d8e18fe624` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:28.539868 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ccbbf2b2124c28b7f8e5d8e18fe624)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:28.542075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:28.619405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ccbbf2b2124c28b7f8e5d8e18fe624'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.620974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ccbbf2b2124c28b7f8e5d8e18fe624'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.637146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ccbbf2b2124c28b7f8e5d8e18fe624'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.660541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ccbbf2b2124c28b7f8e5d8e18fe624'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.661409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ccbbf2b2124c28b7f8e5d8e18fe624'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:28.679975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 932/1842] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:28 2022] DELETE /identity/v3/users/43ccbbf2b2124c28b7f8e5d8e18fe624 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:28.808921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:28.810406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:28.837952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ca38a-2d5b-4529-b486-463be243fc67 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:28.936199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:29.018394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.019333 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.019831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.020615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] PATH_INFO: `/v3/projects/6546534cb722478aaeb0b94af07d8554` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.022453 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6546534cb722478aaeb0b94af07d8554)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.025720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.132093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6546534cb722478aaeb0b94af07d8554', 'request_id': 'req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:29.141726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6546534cb722478aaeb0b94af07d8554', 'request_id': 'req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:29.150782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6546534cb722478aaeb0b94af07d8554', 'request_id': 'req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:29.159756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.161441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:29.176005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] The token cache is being invalidate because project 6546534cb722478aaeb0b94af07d8554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:29.176469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:29.179837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01ddb41a-cbe5-4fb1-a92d-81ff266a5334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:29.181744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 911/1843] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:28 2022] DELETE /identity/v3/projects/6546534cb722478aaeb0b94af07d8554 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:29.186823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2fc3c-d641-4f67-9df8-215e41210576 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.187211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2fc3c-d641-4f67-9df8-215e41210576 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.187581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2fc3c-d641-4f67-9df8-215e41210576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.191251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbe03f-3733-4eb4-9179-5c18dda5baf4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.230465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-aaf2fc3c-d641-4f67-9df8-215e41210576 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:29.230465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aaf2fc3c-d641-4f67-9df8-215e41210576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:29.287559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.288223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.288534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.288841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] PATH_INFO: `/v3/projects/611112cf99b24e68b36d63c577c5c476` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.290257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=611112cf99b24e68b36d63c577c5c476)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.295026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.316599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 912/1844] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:29.325037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c6035-17a1-4f4d-b746-d9ca99bca85a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.325366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c6035-17a1-4f4d-b746-d9ca99bca85a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.325682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c6035-17a1-4f4d-b746-d9ca99bca85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.345914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-552c6035-17a1-4f4d-b746-d9ca99bca85a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:29.347239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-552c6035-17a1-4f4d-b746-d9ca99bca85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:29.363678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611112cf99b24e68b36d63c577c5c476', 'request_id': 'req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:29.369365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:29.374486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611112cf99b24e68b36d63c577c5c476', 'request_id': 'req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:29.381776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611112cf99b24e68b36d63c577c5c476', 'request_id': 'req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:29.405428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] The token cache is being invalidate because project 611112cf99b24e68b36d63c577c5c476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:29.407906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:29.408767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2d578d69-ee5e-4b83-84d9-13ea9f05ec7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:29.412271 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 933/1845] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:29 2022] DELETE /identity/v3/projects/611112cf99b24e68b36d63c577c5c476 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:29.417539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ac2d-47a0-45bd-bcf4-b236693d6bc2 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.417893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ac2d-47a0-45bd-bcf4-b236693d6bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.418460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ac2d-47a0-45bd-bcf4-b236693d6bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.432278 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:29.447024 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 913/1846] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:29.448184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c6035-17a1-4f4d-b746-d9ca99bca85a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.448636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9af4ac2d-47a0-45bd-bcf4-b236693d6bc2 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:29.450098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9af4ac2d-47a0-45bd-bcf4-b236693d6bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:29.458408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c6035-17a1-4f4d-b746-d9ca99bca85a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.462590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 934/1847] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:29.470293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74408daf-79f9-4281-8e8b-ecff762c4d91 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.470606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74408daf-79f9-4281-8e8b-ecff762c4d91 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.470907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74408daf-79f9-4281-8e8b-ecff762c4d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.479025 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9ffdc-c6b8-4cd7-aa19-7a7ae3f07127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.480877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9ffdc-c6b8-4cd7-aa19-7a7ae3f07127 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.481171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9ffdc-c6b8-4cd7-aa19-7a7ae3f07127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.481449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9ffdc-c6b8-4cd7-aa19-7a7ae3f07127 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.483415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9ffdc-c6b8-4cd7-aa19-7a7ae3f07127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:29.483729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9ffdc-c6b8-4cd7-aa19-7a7ae3f07127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.486042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9ffdc-c6b8-4cd7-aa19-7a7ae3f07127 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.497827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-74408daf-79f9-4281-8e8b-ecff762c4d91 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:29.500484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-74408daf-79f9-4281-8e8b-ecff762c4d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:29.519441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 935/1848] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:29.521223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74408daf-79f9-4281-8e8b-ecff762c4d91 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.524693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 914/1849] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:29.529403 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9ffdc-c6b8-4cd7-aa19-7a7ae3f07127 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.534158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74408daf-79f9-4281-8e8b-ecff762c4d91 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.539286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98365dbb-78b6-4432-80da-e4869ea1278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.540378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98365dbb-78b6-4432-80da-e4869ea1278c admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.540873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98365dbb-78b6-4432-80da-e4869ea1278c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.541223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98365dbb-78b6-4432-80da-e4869ea1278c admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.542003 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98365dbb-78b6-4432-80da-e4869ea1278c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:29.542402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98365dbb-78b6-4432-80da-e4869ea1278c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.544171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98365dbb-78b6-4432-80da-e4869ea1278c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.556092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9ffdc-c6b8-4cd7-aa19-7a7ae3f07127 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.562281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ecd6c-f96a-46df-b23b-c8e17a5311fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.563053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ecd6c-f96a-46df-b23b-c8e17a5311fd admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.563380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ecd6c-f96a-46df-b23b-c8e17a5311fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.563733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ecd6c-f96a-46df-b23b-c8e17a5311fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.564445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ecd6c-f96a-46df-b23b-c8e17a5311fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.565601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 936/1850] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:29.567107 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ecd6c-f96a-46df-b23b-c8e17a5311fd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.570592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98365dbb-78b6-4432-80da-e4869ea1278c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.580998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98365dbb-78b6-4432-80da-e4869ea1278c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.590000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2538738-ace5-4c71-9acb-b4803581f811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.590675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538738-ace5-4c71-9acb-b4803581f811 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.591046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538738-ace5-4c71-9acb-b4803581f811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.591330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538738-ace5-4c71-9acb-b4803581f811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.592085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2538738-ace5-4c71-9acb-b4803581f811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.594000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2538738-ace5-4c71-9acb-b4803581f811 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.602144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 915/1851] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:29 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:29.606673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ecd6c-f96a-46df-b23b-c8e17a5311fd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.633987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 937/1852] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:29 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:09:29.635418 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2538738-ace5-4c71-9acb-b4803581f811 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.682293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ecd6c-f96a-46df-b23b-c8e17a5311fd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.723334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2538738-ace5-4c71-9acb-b4803581f811 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.732122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9fed7-83a4-43a8-abc7-ebbb03dbe5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.733125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9fed7-83a4-43a8-abc7-ebbb03dbe5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.734151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9fed7-83a4-43a8-abc7-ebbb03dbe5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.734851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9fed7-83a4-43a8-abc7-ebbb03dbe5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.735783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9fed7-83a4-43a8-abc7-ebbb03dbe5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.739052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9fed7-83a4-43a8-abc7-ebbb03dbe5e4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.746312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a1c8-ee09-4ad7-83cc-d0649e2fe3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.747034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a1c8-ee09-4ad7-83cc-d0649e2fe3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.747402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a1c8-ee09-4ad7-83cc-d0649e2fe3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.747736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a1c8-ee09-4ad7-83cc-d0649e2fe3e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.748461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5a1c8-ee09-4ad7-83cc-d0649e2fe3e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.750425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5a1c8-ee09-4ad7-83cc-d0649e2fe3e0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.767700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 938/1853] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:29 2022] POST /identity/v3/users => generated 282 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:29.772142 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9fed7-83a4-43a8-abc7-ebbb03dbe5e4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.782469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 916/1854] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:29 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:09:29.785550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9fed7-83a4-43a8-abc7-ebbb03dbe5e4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.786593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a1c8-ee09-4ad7-83cc-d0649e2fe3e0 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.793301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28255a18-7091-462c-a0ab-d8bc60280da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.794030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255a18-7091-462c-a0ab-d8bc60280da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.794364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255a18-7091-462c-a0ab-d8bc60280da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.794742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255a18-7091-462c-a0ab-d8bc60280da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.795551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28255a18-7091-462c-a0ab-d8bc60280da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.798018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28255a18-7091-462c-a0ab-d8bc60280da7 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.805096 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a1c8-ee09-4ad7-83cc-d0649e2fe3e0 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.811616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f2fac-8283-48e1-95c1-8d020749ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.812172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2fac-8283-48e1-95c1-8d020749ab79 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.812456 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2fac-8283-48e1-95c1-8d020749ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.812884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2fac-8283-48e1-95c1-8d020749ab79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.813597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f2fac-8283-48e1-95c1-8d020749ab79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.816023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f2fac-8283-48e1-95c1-8d020749ab79 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.816497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 939/1855] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:29.820546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28255a18-7091-462c-a0ab-d8bc60280da7 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.831572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28255a18-7091-462c-a0ab-d8bc60280da7 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.837623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 917/1856] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:29.841522 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f2fac-8283-48e1-95c1-8d020749ab79 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.843431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d83d-ea8e-447e-be08-9a5a383fbe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.844268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d83d-ea8e-447e-be08-9a5a383fbe98 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.844871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d83d-ea8e-447e-be08-9a5a383fbe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.845306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198d83d-ea8e-447e-be08-9a5a383fbe98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.847289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198d83d-ea8e-447e-be08-9a5a383fbe98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.849538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198d83d-ea8e-447e-be08-9a5a383fbe98 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.868271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f2fac-8283-48e1-95c1-8d020749ab79 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.870727 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 940/1857] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:29.878673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d83d-ea8e-447e-be08-9a5a383fbe98 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.886058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6ed57-71bb-49ce-af03-737e60550ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.886727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6ed57-71bb-49ce-af03-737e60550ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.887009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6ed57-71bb-49ce-af03-737e60550ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.887282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6ed57-71bb-49ce-af03-737e60550ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.889224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6ed57-71bb-49ce-af03-737e60550ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.890694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198d83d-ea8e-447e-be08-9a5a383fbe98 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.891123 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6ed57-71bb-49ce-af03-737e60550ca6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.897634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704357c7-a541-43f9-b519-9ebda6f0b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:29.898883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704357c7-a541-43f9-b519-9ebda6f0b3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.899309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704357c7-a541-43f9-b519-9ebda6f0b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.899759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704357c7-a541-43f9-b519-9ebda6f0b3c8 admin admin] PATH_INFO: `/v3/projects/0a42aaec38184c22973cded0efc51060/users/a786aa58a5d34bb89835eb4ac050b80c/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:29.928442 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 918/1858] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:29.931697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704357c7-a541-43f9-b519-9ebda6f0b3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a42aaec38184c22973cded0efc51060, user_id=a786aa58a5d34bb89835eb4ac050b80c, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:29.934750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704357c7-a541-43f9-b519-9ebda6f0b3c8 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:29.940448 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6ed57-71bb-49ce-af03-737e60550ca6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:29.968126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6ed57-71bb-49ce-af03-737e60550ca6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:29.987291 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 941/1859] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:29 2022] PUT /identity/v3/projects/0a42aaec38184c22973cded0efc51060/users/a786aa58a5d34bb89835eb4ac050b80c/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:29.991129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafd6f1-5b8a-4432-86f2-25b7e2c49053 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:29.991523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafd6f1-5b8a-4432-86f2-25b7e2c49053 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:29.996510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafd6f1-5b8a-4432-86f2-25b7e2c49053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:30.053798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-0eafd6f1-5b8a-4432-86f2-25b7e2c49053 None None] MFA Rules not processed for user `a786aa58a5d34bb89835eb4ac050b80c`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:30.057660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:30.058691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0eafd6f1-5b8a-4432-86f2-25b7e2c49053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:30.107038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:30.123996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7546f8-620f-48ec-8343-4d5050291efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:30.124800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7546f8-620f-48ec-8343-4d5050291efd admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:30.125173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7546f8-620f-48ec-8343-4d5050291efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:30.125789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7546f8-620f-48ec-8343-4d5050291efd admin admin] PATH_INFO: `/v3/projects/a602911b2fd246ac8b1aad1577d652b0/users/1a4e3ba2313f433c8d7712f8a926c85d/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:30.160726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7546f8-620f-48ec-8343-4d5050291efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a602911b2fd246ac8b1aad1577d652b0, user_id=1a4e3ba2313f433c8d7712f8a926c85d, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:30.166410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7546f8-620f-48ec-8343-4d5050291efd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:30.213360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 919/1860] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:29 2022] PUT /identity/v3/projects/a602911b2fd246ac8b1aad1577d652b0/users/1a4e3ba2313f433c8d7712f8a926c85d/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:30.213696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 942/1861] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:30.216233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878a567-2512-4efe-b8e7-aca4367eb730 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:30.216522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878a567-2512-4efe-b8e7-aca4367eb730 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:30.216831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878a567-2512-4efe-b8e7-aca4367eb730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:30.218760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7546f8-620f-48ec-8343-4d5050291efd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:30.324240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-c878a567-2512-4efe-b8e7-aca4367eb730 None None] MFA Rules not processed for user `1a4e3ba2313f433c8d7712f8a926c85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:30.325493 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c878a567-2512-4efe-b8e7-aca4367eb730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:30.412241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7546f8-620f-48ec-8343-4d5050291efd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:30.420181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229fed0-52bd-41cf-b720-83f1f0bf117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:30.421266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229fed0-52bd-41cf-b720-83f1f0bf117e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:30.421611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229fed0-52bd-41cf-b720-83f1f0bf117e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:30.422050 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229fed0-52bd-41cf-b720-83f1f0bf117e admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:30.424821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229fed0-52bd-41cf-b720-83f1f0bf117e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:30.426797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229fed0-52bd-41cf-b720-83f1f0bf117e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:30.455551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 943/1862] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:30.459869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878a567-2512-4efe-b8e7-aca4367eb730 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:30.483504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 920/1863] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:30 2022] POST /identity/v3/projects => generated 361 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:30.485070 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229fed0-52bd-41cf-b720-83f1f0bf117e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:30.493415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878a567-2512-4efe-b8e7-aca4367eb730 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:30.576535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229fed0-52bd-41cf-b720-83f1f0bf117e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:30.582290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f990dc-01a2-41e9-8067-c84c5148d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:30.582770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f990dc-01a2-41e9-8067-c84c5148d8fa admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:30.583294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f990dc-01a2-41e9-8067-c84c5148d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:30.583294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f990dc-01a2-41e9-8067-c84c5148d8fa admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:30.583971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f990dc-01a2-41e9-8067-c84c5148d8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:30.585970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f990dc-01a2-41e9-8067-c84c5148d8fa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:30.604705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7612b5-07c7-41e3-8dcc-d7cde75d70f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:30.606006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7612b5-07c7-41e3-8dcc-d7cde75d70f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:30.606006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7612b5-07c7-41e3-8dcc-d7cde75d70f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:30.606006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7612b5-07c7-41e3-8dcc-d7cde75d70f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:30.606674 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7612b5-07c7-41e3-8dcc-d7cde75d70f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:30.609174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7612b5-07c7-41e3-8dcc-d7cde75d70f1 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:30.626393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 921/1864] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:30 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:30.631710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f990dc-01a2-41e9-8067-c84c5148d8fa admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:30.634312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-30f990dc-01a2-41e9-8067-c84c5148d8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:30.651610 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 944/1865] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:30 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:30.651610 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7612b5-07c7-41e3-8dcc-d7cde75d70f1 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:30.691055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:30.728463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:30.729489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f990dc-01a2-41e9-8067-c84c5148d8fa admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:30.753958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7612b5-07c7-41e3-8dcc-d7cde75d70f1 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:30.760358 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c97a-ef98-4101-bf6a-efb3caabe6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:30.761086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c97a-ef98-4101-bf6a-efb3caabe6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:30.761460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c97a-ef98-4101-bf6a-efb3caabe6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:30.761830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c97a-ef98-4101-bf6a-efb3caabe6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:30.762678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c97a-ef98-4101-bf6a-efb3caabe6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:30.764452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c97a-ef98-4101-bf6a-efb3caabe6a5 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:30.780840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 945/1866] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:30.780840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c97a-ef98-4101-bf6a-efb3caabe6a5 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:30.797556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c97a-ef98-4101-bf6a-efb3caabe6a5 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:30.803254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33766f0e-afcb-4a22-9e79-c27869c96cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:30.804678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33766f0e-afcb-4a22-9e79-c27869c96cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:30.806887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33766f0e-afcb-4a22-9e79-c27869c96cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:30.807266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33766f0e-afcb-4a22-9e79-c27869c96cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:30.809572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33766f0e-afcb-4a22-9e79-c27869c96cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:30.815025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33766f0e-afcb-4a22-9e79-c27869c96cb1 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:30.832384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c14259-e734-4005-9d2d-77ebbdedcdf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:30.833200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c14259-e734-4005-9d2d-77ebbdedcdf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:30.833646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c14259-e734-4005-9d2d-77ebbdedcdf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:30.834103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c14259-e734-4005-9d2d-77ebbdedcdf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:30.837618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-80c14259-e734-4005-9d2d-77ebbdedcdf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:30.868606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 946/1867] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:30 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:30.869573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33766f0e-afcb-4a22-9e79-c27869c96cb1 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:30.886622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33766f0e-afcb-4a22-9e79-c27869c96cb1 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:30.896085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aae8f-7521-42d5-a5cc-ec55059f03ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:30.897079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aae8f-7521-42d5-a5cc-ec55059f03ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:30.897503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aae8f-7521-42d5-a5cc-ec55059f03ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:30.898311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aae8f-7521-42d5-a5cc-ec55059f03ac admin admin] PATH_INFO: `/v3/projects/07546eb6260641c392b054e6efdc32c8/users/6a89423db169495abcfb1a5dc935cb8d/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:30.921436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aae8f-7521-42d5-a5cc-ec55059f03ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=07546eb6260641c392b054e6efdc32c8, user_id=6a89423db169495abcfb1a5dc935cb8d, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:30.925322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aae8f-7521-42d5-a5cc-ec55059f03ac admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:30.941213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c14259-e734-4005-9d2d-77ebbdedcdf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:30.943962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 947/1868] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:30 2022] PUT /identity/v3/projects/07546eb6260641c392b054e6efdc32c8/users/6a89423db169495abcfb1a5dc935cb8d/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:30.944896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aae8f-7521-42d5-a5cc-ec55059f03ac admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:30.947011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c14259-e734-4005-9d2d-77ebbdedcdf5 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:30.959808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 922/1869] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:30.961752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c14259-e734-4005-9d2d-77ebbdedcdf5 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:30.989087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c14259-e734-4005-9d2d-77ebbdedcdf5 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:31.082857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aae8f-7521-42d5-a5cc-ec55059f03ac admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:31.096499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9d150-d40b-404d-822f-d7adb53cd092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:31.097399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9d150-d40b-404d-822f-d7adb53cd092 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.098504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9d150-d40b-404d-822f-d7adb53cd092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.098830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9d150-d40b-404d-822f-d7adb53cd092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.099706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9d150-d40b-404d-822f-d7adb53cd092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:31.100504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657a201-8a70-4258-a68e-6b1ff8f8be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:31.101935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657a201-8a70-4258-a68e-6b1ff8f8be4c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.102293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657a201-8a70-4258-a68e-6b1ff8f8be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.102697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657a201-8a70-4258-a68e-6b1ff8f8be4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.103541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657a201-8a70-4258-a68e-6b1ff8f8be4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:31.103723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9d150-d40b-404d-822f-d7adb53cd092 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:31.118423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657a201-8a70-4258-a68e-6b1ff8f8be4c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:31.150307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 923/1870] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:31.151747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657a201-8a70-4258-a68e-6b1ff8f8be4c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:31.159186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 948/1871] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:31.160570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9d150-d40b-404d-822f-d7adb53cd092 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:31.168885 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657a201-8a70-4258-a68e-6b1ff8f8be4c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:31.177054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e3fb8-5990-40ca-a244-9d9de38d6de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:31.177422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9d150-d40b-404d-822f-d7adb53cd092 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:31.178236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3fb8-5990-40ca-a244-9d9de38d6de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.178752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3fb8-5990-40ca-a244-9d9de38d6de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.179205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3fb8-5990-40ca-a244-9d9de38d6de6 admin admin] PATH_INFO: `/v3/projects/07546eb6260641c392b054e6efdc32c8/users/6a89423db169495abcfb1a5dc935cb8d/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.181460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e3fb8-5990-40ca-a244-9d9de38d6de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07546eb6260641c392b054e6efdc32c8, user_id=6a89423db169495abcfb1a5dc935cb8d, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:31.184137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b4bdb-7d8f-4342-907b-2156197b8bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:31.184313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e3fb8-5990-40ca-a244-9d9de38d6de6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:31.186318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b4bdb-7d8f-4342-907b-2156197b8bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.186797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b4bdb-7d8f-4342-907b-2156197b8bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.187726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b4bdb-7d8f-4342-907b-2156197b8bd3 admin admin] PATH_INFO: `/v3/projects/5bbe6a35dfa54a359c675464041efdc3/users/f986e593c69f4dff8b15ea325a572e04/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.200456 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 924/1872] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:31 2022] PUT /identity/v3/projects/07546eb6260641c392b054e6efdc32c8/users/6a89423db169495abcfb1a5dc935cb8d/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:31.211584 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b4385-823b-46ec-b526-5c103742a094 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.211947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b4385-823b-46ec-b526-5c103742a094 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.212298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b4385-823b-46ec-b526-5c103742a094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.225536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b4bdb-7d8f-4342-907b-2156197b8bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bbe6a35dfa54a359c675464041efdc3, user_id=f986e593c69f4dff8b15ea325a572e04, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:31.233026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b4bdb-7d8f-4342-907b-2156197b8bd3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:31.246651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-764b4385-823b-46ec-b526-5c103742a094 None None] MFA Rules not processed for user `6a89423db169495abcfb1a5dc935cb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:31.248381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-764b4385-823b-46ec-b526-5c103742a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:31.256611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 949/1873] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:31 2022] PUT /identity/v3/projects/5bbe6a35dfa54a359c675464041efdc3/users/f986e593c69f4dff8b15ea325a572e04/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:31.261570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b4bdb-7d8f-4342-907b-2156197b8bd3 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:31.279912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:31.358772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 925/1874] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:31 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:31.364271 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b4bdb-7d8f-4342-907b-2156197b8bd3 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:31.371962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b4385-823b-46ec-b526-5c103742a094 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:31.373972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-764b4385-823b-46ec-b526-5c103742a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:31.374373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb8b17-e73b-42c9-8def-7d4754ea4421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:31.375143 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb8b17-e73b-42c9-8def-7d4754ea4421 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.375466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb8b17-e73b-42c9-8def-7d4754ea4421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.375794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb8b17-e73b-42c9-8def-7d4754ea4421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.376563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb8b17-e73b-42c9-8def-7d4754ea4421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:31.378877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb8b17-e73b-42c9-8def-7d4754ea4421 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:31.404228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 950/1875] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:31.405169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb8b17-e73b-42c9-8def-7d4754ea4421 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:31.418210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:31.423593 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb8b17-e73b-42c9-8def-7d4754ea4421 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:31.433313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a7489-7cc3-4bd9-b037-7a4e4e3ff3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:31.434078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a7489-7cc3-4bd9-b037-7a4e4e3ff3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.434898 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a7489-7cc3-4bd9-b037-7a4e4e3ff3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.435183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a7489-7cc3-4bd9-b037-7a4e4e3ff3ce admin admin] PATH_INFO: `/v3/projects/5bbe6a35dfa54a359c675464041efdc3/users/f986e593c69f4dff8b15ea325a572e04/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.441255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a7489-7cc3-4bd9-b037-7a4e4e3ff3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bbe6a35dfa54a359c675464041efdc3, user_id=f986e593c69f4dff8b15ea325a572e04, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:31.447125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a7489-7cc3-4bd9-b037-7a4e4e3ff3ce admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:31.481374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b4385-823b-46ec-b526-5c103742a094 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:31.485928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 951/1876] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:31 2022] PUT /identity/v3/projects/5bbe6a35dfa54a359c675464041efdc3/users/f986e593c69f4dff8b15ea325a572e04/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:31.487576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79a06-2b9c-4736-86c0-ba58f8bcbc4a None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.487989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79a06-2b9c-4736-86c0-ba58f8bcbc4a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.488291 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79a06-2b9c-4736-86c0-ba58f8bcbc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.531565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-49c79a06-2b9c-4736-86c0-ba58f8bcbc4a None None] MFA Rules not processed for user `f986e593c69f4dff8b15ea325a572e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:31.532856 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-49c79a06-2b9c-4736-86c0-ba58f8bcbc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:31.557606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e15104-7e02-4894-96a7-b0d0ab877dda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:31.558624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e15104-7e02-4894-96a7-b0d0ab877dda service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.559009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e15104-7e02-4894-96a7-b0d0ab877dda service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.559409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e15104-7e02-4894-96a7-b0d0ab877dda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.706888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 952/1877] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:31.709009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a51c7-3ee9-478e-8cbc-529d228359e8 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.709457 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a51c7-3ee9-478e-8cbc-529d228359e8 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.709891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a51c7-3ee9-478e-8cbc-529d228359e8 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.711681 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 953/1878] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:09:31.718979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e15104-7e02-4894-96a7-b0d0ab877dda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:31.720451 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e15104-7e02-4894-96a7-b0d0ab877dda service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:31.722960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b0a8-bc74-42c3-bc27-6e665c5d86d5 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.723941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b0a8-bc74-42c3-bc27-6e665c5d86d5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.724386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b0a8-bc74-42c3-bc27-6e665c5d86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.733408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 926/1879] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:31 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:09:31.770041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9635b0a8-bc74-42c3-bc27-6e665c5d86d5 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:31.781598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9635b0a8-bc74-42c3-bc27-6e665c5d86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:31.864288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e15104-7e02-4894-96a7-b0d0ab877dda service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:31.881769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e15104-7e02-4894-96a7-b0d0ab877dda service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:31.888823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127c4a8-b13a-4e31-ac83-99f40e1e7b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:31.889453 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127c4a8-b13a-4e31-ac83-99f40e1e7b2a service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:31.889728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127c4a8-b13a-4e31-ac83-99f40e1e7b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:31.890022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127c4a8-b13a-4e31-ac83-99f40e1e7b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:31.909416 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127c4a8-b13a-4e31-ac83-99f40e1e7b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:31.911885 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127c4a8-b13a-4e31-ac83-99f40e1e7b2a service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:31.948529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 954/1880] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:09:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:31.948792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 927/1881] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:32.119651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635b0a8-bc74-42c3-bc27-6e665c5d86d5 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:32.121396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9635b0a8-bc74-42c3-bc27-6e665c5d86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:32.147307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635b0a8-bc74-42c3-bc27-6e665c5d86d5 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:32.154642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725dd94-3ab1-4427-974f-3f3608bb155f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:32.155439 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725dd94-3ab1-4427-974f-3f3608bb155f service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:32.155722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725dd94-3ab1-4427-974f-3f3608bb155f service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:32.156035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725dd94-3ab1-4427-974f-3f3608bb155f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:32.180180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725dd94-3ab1-4427-974f-3f3608bb155f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:32.182103 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725dd94-3ab1-4427-974f-3f3608bb155f service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:32.194708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 955/1882] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:32.733193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127c4a8-b13a-4e31-ac83-99f40e1e7b2a service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:32.748872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:32.763649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725dd94-3ab1-4427-974f-3f3608bb155f service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:32.813695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127c4a8-b13a-4e31-ac83-99f40e1e7b2a service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:32.819175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:32.820368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:32.820636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:32.820907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] PATH_INFO: `/v3/users/a786aa58a5d34bb89835eb4ac050b80c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:32.822159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a786aa58a5d34bb89835eb4ac050b80c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:32.824166 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:32.842670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:32.849886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725dd94-3ab1-4427-974f-3f3608bb155f service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:32.857145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:32.858133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:32.858530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:32.859189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] PATH_INFO: `/v3/users/1a4e3ba2313f433c8d7712f8a926c85d` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:32.860047 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a4e3ba2313f433c8d7712f8a926c85d)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:32.862241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:32.885953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a786aa58a5d34bb89835eb4ac050b80c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:32.886622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a786aa58a5d34bb89835eb4ac050b80c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:32.896022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a786aa58a5d34bb89835eb4ac050b80c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:32.909811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a786aa58a5d34bb89835eb4ac050b80c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:32.910521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-35f4cb8d-8000-4ff4-9838-a952da104e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a786aa58a5d34bb89835eb4ac050b80c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:32.918074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a4e3ba2313f433c8d7712f8a926c85d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:32.918817 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a4e3ba2313f433c8d7712f8a926c85d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:32.923240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 928/1883] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:32 2022] DELETE /identity/v3/users/a786aa58a5d34bb89835eb4ac050b80c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:32.926183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a4e3ba2313f433c8d7712f8a926c85d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:32.928047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430578c0-e58c-4e63-8d5a-4e67c830e50f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:32.928351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430578c0-e58c-4e63-8d5a-4e67c830e50f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:32.928678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430578c0-e58c-4e63-8d5a-4e67c830e50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:32.939119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a4e3ba2313f433c8d7712f8a926c85d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:32.940073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ecbe872e-f4b9-4945-bf9e-7b22575291b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a4e3ba2313f433c8d7712f8a926c85d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:32.948257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-430578c0-e58c-4e63-8d5a-4e67c830e50f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:32.949483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-430578c0-e58c-4e63-8d5a-4e67c830e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:32.955164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 956/1884] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:32 2022] DELETE /identity/v3/users/1a4e3ba2313f433c8d7712f8a926c85d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:32.964624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd25e36-eab4-49c1-9356-27425b7fdc0b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:32.966353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd25e36-eab4-49c1-9356-27425b7fdc0b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:32.966736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd25e36-eab4-49c1-9356-27425b7fdc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:32.991196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-8fd25e36-eab4-49c1-9356-27425b7fdc0b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:32.993200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8fd25e36-eab4-49c1-9356-27425b7fdc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:33.019780 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 929/1885] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:33.045791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430578c0-e58c-4e63-8d5a-4e67c830e50f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:33.050750 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-430578c0-e58c-4e63-8d5a-4e67c830e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:33.072799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 957/1886] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:33.130805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:33.169152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430578c0-e58c-4e63-8d5a-4e67c830e50f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:33.199215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd25e36-eab4-49c1-9356-27425b7fdc0b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:33.235345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c3141-b15d-492f-9792-68704a0bdfc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:33.236011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3141-b15d-492f-9792-68704a0bdfc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:33.236425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3141-b15d-492f-9792-68704a0bdfc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:33.236721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3141-b15d-492f-9792-68704a0bdfc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:33.248008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c3141-b15d-492f-9792-68704a0bdfc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:33.249684 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c3141-b15d-492f-9792-68704a0bdfc6 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:33.262969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 930/1887] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:33.280772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd25e36-eab4-49c1-9356-27425b7fdc0b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:33.284738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c871b6f-6b1c-495b-8140-c22f84fcd514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:33.285452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c871b6f-6b1c-495b-8140-c22f84fcd514 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:33.287329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c871b6f-6b1c-495b-8140-c22f84fcd514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:33.287679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c871b6f-6b1c-495b-8140-c22f84fcd514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:33.299000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c871b6f-6b1c-495b-8140-c22f84fcd514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:33.300978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c871b6f-6b1c-495b-8140-c22f84fcd514 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:33.313453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 958/1888] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:09:33.960496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c3141-b15d-492f-9792-68704a0bdfc6 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:33.961952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-119c3141-b15d-492f-9792-68704a0bdfc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:33.976794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c3141-b15d-492f-9792-68704a0bdfc6 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:33.982878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:33.983563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:33.983840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:33.984110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] PATH_INFO: `/v3/users/0d7d6a168d214b1d88a3f0b1835923d9` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:33.985657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7d6a168d214b1d88a3f0b1835923d9)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:33.987844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:34.076080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7d6a168d214b1d88a3f0b1835923d9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:34.076815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7d6a168d214b1d88a3f0b1835923d9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:34.086989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7d6a168d214b1d88a3f0b1835923d9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:34.124243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7d6a168d214b1d88a3f0b1835923d9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:34.125364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7d6a168d214b1d88a3f0b1835923d9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:34.169924 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23244-0de6-460c-8865-0799ae03234b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:34.170505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23244-0de6-460c-8865-0799ae03234b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:34.170605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 931/1889] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:33 2022] DELETE /identity/v3/users/0d7d6a168d214b1d88a3f0b1835923d9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:34.170690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23244-0de6-460c-8865-0799ae03234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:34.201335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-b5d23244-0de6-460c-8865-0799ae03234b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:34.202502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b5d23244-0de6-460c-8865-0799ae03234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:34.217482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:34.321689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 959/1890] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:34.361147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:34.363608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:34.457205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee55ddf-8c9b-403b-a51d-6896a357ac8a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:34.463147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cd640-86fc-4370-a651-7b5ace277e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:34.464577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cd640-86fc-4370-a651-7b5ace277e83 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:34.465005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cd640-86fc-4370-a651-7b5ace277e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:34.465479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cd640-86fc-4370-a651-7b5ace277e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:34.480130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cd640-86fc-4370-a651-7b5ace277e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:34.481796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cd640-86fc-4370-a651-7b5ace277e83 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:34.498339 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 932/1891] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:34.963758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d23244-0de6-460c-8865-0799ae03234b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:34.965540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b5d23244-0de6-460c-8865-0799ae03234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:34.991715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d23244-0de6-460c-8865-0799ae03234b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:35.002796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cd640-86fc-4370-a651-7b5ace277e83 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:35.003911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:35.007860 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dd5cd640-86fc-4370-a651-7b5ace277e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:35.007953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:35.007953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:35.007953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] PATH_INFO: `/v3/projects/93dae080aba9439bb3ef14f465534d74` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:35.008692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93dae080aba9439bb3ef14f465534d74)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:35.012515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:35.024938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:35.037579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cd640-86fc-4370-a651-7b5ace277e83 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:35.048873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:35.050737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:35.051368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:35.051802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] PATH_INFO: `/v3/projects/a602911b2fd246ac8b1aad1577d652b0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:35.053703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a602911b2fd246ac8b1aad1577d652b0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:35.056381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:35.079848 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93dae080aba9439bb3ef14f465534d74', 'request_id': 'req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.091432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93dae080aba9439bb3ef14f465534d74', 'request_id': 'req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.098409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93dae080aba9439bb3ef14f465534d74', 'request_id': 'req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.113122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] The token cache is being invalidate because project 93dae080aba9439bb3ef14f465534d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:35.113463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.114160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.117139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a602911b2fd246ac8b1aad1577d652b0', 'request_id': 'req-e6d162cd-5781-4175-8027-427d2fd6dbec'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.119705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 960/1892] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:34 2022] DELETE /identity/v3/projects/93dae080aba9439bb3ef14f465534d74 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:35.120632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:35.122073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:35.125822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a602911b2fd246ac8b1aad1577d652b0', 'request_id': 'req-e6d162cd-5781-4175-8027-427d2fd6dbec'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.134194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a602911b2fd246ac8b1aad1577d652b0', 'request_id': 'req-e6d162cd-5781-4175-8027-427d2fd6dbec'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.149589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] The token cache is being invalidate because project a602911b2fd246ac8b1aad1577d652b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:35.154825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.156295 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.158893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 933/1893] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:35 2022] DELETE /identity/v3/projects/a602911b2fd246ac8b1aad1577d652b0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:35.163724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:35.165469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:35.215033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b10a4-b244-41b0-9b4a-c1d17dc616c7 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:35.249073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d162cd-5781-4175-8027-427d2fd6dbec admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:35.263153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:35.264993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:35.265976 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:35.266142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] PATH_INFO: `/v3/users/e69bbf5976704384aa14f218c3aa41ac` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:35.267970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69bbf5976704384aa14f218c3aa41ac)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:35.269708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:35.272290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:35.297717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:35.298886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:35.299175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:35.299452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] PATH_INFO: `/v3/projects/0a42aaec38184c22973cded0efc51060` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:35.301132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a42aaec38184c22973cded0efc51060)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:35.303801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:35.372910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69bbf5976704384aa14f218c3aa41ac'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.373626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69bbf5976704384aa14f218c3aa41ac'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.373990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a42aaec38184c22973cded0efc51060', 'request_id': 'req-09d488ff-7b35-4a41-a15d-660b1403185b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.389381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a42aaec38184c22973cded0efc51060', 'request_id': 'req-09d488ff-7b35-4a41-a15d-660b1403185b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.393987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69bbf5976704384aa14f218c3aa41ac'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.399165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a42aaec38184c22973cded0efc51060', 'request_id': 'req-09d488ff-7b35-4a41-a15d-660b1403185b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.411615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] The token cache is being invalidate because project 0a42aaec38184c22973cded0efc51060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:35.412224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.413077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.415144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 961/1894] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:35 2022] DELETE /identity/v3/projects/0a42aaec38184c22973cded0efc51060 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:35.415672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69bbf5976704384aa14f218c3aa41ac'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.416243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:35.416379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69bbf5976704384aa14f218c3aa41ac'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.418141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:35.451005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 934/1895] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:35 2022] DELETE /identity/v3/users/e69bbf5976704384aa14f218c3aa41ac => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:35.451840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:35.453263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:35.478061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:35.529191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d488ff-7b35-4a41-a15d-660b1403185b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:35.605967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd15e89-d204-440a-9a11-ab1e05076f0e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:35.612298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:35.613441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:35.613890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:35.614244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] PATH_INFO: `/v3/users/6a89423db169495abcfb1a5dc935cb8d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:35.617290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a89423db169495abcfb1a5dc935cb8d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:35.619948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:35.636779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:35.637804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:35.638331 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:35.639007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] PATH_INFO: `/v3/users/f986e593c69f4dff8b15ea325a572e04` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:35.640643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f986e593c69f4dff8b15ea325a572e04)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:35.643565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:35.685209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:35.712642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a89423db169495abcfb1a5dc935cb8d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.713920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a89423db169495abcfb1a5dc935cb8d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.719225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f986e593c69f4dff8b15ea325a572e04'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.720065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f986e593c69f4dff8b15ea325a572e04'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.724438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a89423db169495abcfb1a5dc935cb8d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.729046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f986e593c69f4dff8b15ea325a572e04'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.740734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a89423db169495abcfb1a5dc935cb8d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.742057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a89423db169495abcfb1a5dc935cb8d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.753887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f986e593c69f4dff8b15ea325a572e04'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.754985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f986e593c69f4dff8b15ea325a572e04'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:35.768888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 935/1896] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:35 2022] DELETE /identity/v3/users/6a89423db169495abcfb1a5dc935cb8d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:35.769778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:35.773287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 962/1897] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:35 2022] DELETE /identity/v3/users/f986e593c69f4dff8b15ea325a572e04 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:35.775555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:35.870964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3080d5-43d7-4c66-9978-87a2ec7ae20f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:35.916663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:35.958194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:35.965987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:35.966641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:35.967117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] PATH_INFO: `/v3/users/fcd1e4a0b3ba49b89efe1bb02046a14f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:35.968723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd1e4a0b3ba49b89efe1bb02046a14f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:35.971186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:36.000676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:36.002821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.040979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd1e4a0b3ba49b89efe1bb02046a14f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.042279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd1e4a0b3ba49b89efe1bb02046a14f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.047212 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498755b-8fd3-4fec-976d-c30c502c5958 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:36.055410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd1e4a0b3ba49b89efe1bb02046a14f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.062412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:36.063317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.063778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.064283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] PATH_INFO: `/v3/projects/510089168baf403eb79102bfce717d58` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.067300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510089168baf403eb79102bfce717d58)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:36.070705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:36.074041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd1e4a0b3ba49b89efe1bb02046a14f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.074941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8a2432ff-8b76-4eeb-9f9b-c2e6ae86546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd1e4a0b3ba49b89efe1bb02046a14f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.110324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 936/1898] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:35 2022] DELETE /identity/v3/users/fcd1e4a0b3ba49b89efe1bb02046a14f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:36.111740 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2936b-3d8d-46e6-86fb-58eb54b5639b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.112203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2936b-3d8d-46e6-86fb-58eb54b5639b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.112487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2936b-3d8d-46e6-86fb-58eb54b5639b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.136575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1af2936b-3d8d-46e6-86fb-58eb54b5639b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:36.138538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1af2936b-3d8d-46e6-86fb-58eb54b5639b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.162354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510089168baf403eb79102bfce717d58', 'request_id': 'req-fcc3cc15-7a6d-454f-b652-16d34aa59222'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.173841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510089168baf403eb79102bfce717d58', 'request_id': 'req-fcc3cc15-7a6d-454f-b652-16d34aa59222'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.203569 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510089168baf403eb79102bfce717d58', 'request_id': 'req-fcc3cc15-7a6d-454f-b652-16d34aa59222'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.221270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] The token cache is being invalidate because project 510089168baf403eb79102bfce717d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:36.221842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.223278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.228965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 963/1899] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:35 2022] DELETE /identity/v3/projects/510089168baf403eb79102bfce717d58 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:36.228965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:36.230549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.248254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 937/1900] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:36.248254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2936b-3d8d-46e6-86fb-58eb54b5639b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:36.250610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1af2936b-3d8d-46e6-86fb-58eb54b5639b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.263961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2936b-3d8d-46e6-86fb-58eb54b5639b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:36.315269 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3cc15-7a6d-454f-b652-16d34aa59222 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:36.319278 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:36.324427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:36.325109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.325397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.325676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] PATH_INFO: `/v3/projects/5bbe6a35dfa54a359c675464041efdc3` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.327492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bbe6a35dfa54a359c675464041efdc3)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:36.341931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:36.348287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:36.349409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.349807 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.350499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] PATH_INFO: `/v3/projects/07546eb6260641c392b054e6efdc32c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.352644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07546eb6260641c392b054e6efdc32c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:36.355610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:36.396320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:36.420273 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bbe6a35dfa54a359c675464041efdc3', 'request_id': 'req-1053ad06-fc18-45c3-9974-492fc980fc05'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.425837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07546eb6260641c392b054e6efdc32c8', 'request_id': 'req-4194308b-1b66-4bb4-8121-4432db88f756'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.431296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bbe6a35dfa54a359c675464041efdc3', 'request_id': 'req-1053ad06-fc18-45c3-9974-492fc980fc05'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.433072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07546eb6260641c392b054e6efdc32c8', 'request_id': 'req-4194308b-1b66-4bb4-8121-4432db88f756'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.441443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07546eb6260641c392b054e6efdc32c8', 'request_id': 'req-4194308b-1b66-4bb4-8121-4432db88f756'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.441651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bbe6a35dfa54a359c675464041efdc3', 'request_id': 'req-1053ad06-fc18-45c3-9974-492fc980fc05'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.456118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] The token cache is being invalidate because project 07546eb6260641c392b054e6efdc32c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:36.456484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.457338 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.457447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] The token cache is being invalidate because project 5bbe6a35dfa54a359c675464041efdc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:36.457647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.458278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.462476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 938/1901] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:36 2022] DELETE /identity/v3/projects/07546eb6260641c392b054e6efdc32c8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:36.462476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:36.462690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 964/1902] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:36 2022] DELETE /identity/v3/projects/5bbe6a35dfa54a359c675464041efdc3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:36.465406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.465599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:36.466958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.537441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194308b-1b66-4bb4-8121-4432db88f756 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:36.543005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:36.543654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.544007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.544186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] PATH_INFO: `/v3/users/455ed2d90f4f4e0fa2417052b6dd4449` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.545498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=455ed2d90f4f4e0fa2417052b6dd4449)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:36.547631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053ad06-fc18-45c3-9974-492fc980fc05 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:36.548033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:36.611966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a59b-21e3-49db-aac8-0d0dc212e1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:36.612844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a59b-21e3-49db-aac8-0d0dc212e1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.612844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a59b-21e3-49db-aac8-0d0dc212e1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.613149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a59b-21e3-49db-aac8-0d0dc212e1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.616274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-73e1a59b-21e3-49db-aac8-0d0dc212e1a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.630659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a59b-21e3-49db-aac8-0d0dc212e1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:36.632137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a59b-21e3-49db-aac8-0d0dc212e1a4 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:36.635875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455ed2d90f4f4e0fa2417052b6dd4449'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.636956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455ed2d90f4f4e0fa2417052b6dd4449'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.646559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 965/1903] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:36.648840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cec8f-8d54-41d9-a862-1a522d79ebbf None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.649213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cec8f-8d54-41d9-a862-1a522d79ebbf None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.649821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cec8f-8d54-41d9-a862-1a522d79ebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.652245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455ed2d90f4f4e0fa2417052b6dd4449'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.674145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455ed2d90f4f4e0fa2417052b6dd4449'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.675640 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7733da6b-458f-45cf-a281-61196304b1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455ed2d90f4f4e0fa2417052b6dd4449'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:36.675753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ab1cec8f-8d54-41d9-a862-1a522d79ebbf None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:36.676869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ab1cec8f-8d54-41d9-a862-1a522d79ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.687672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:36.688421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 966/1904] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:36.689908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac4297-39b0-4b67-8a5f-bb108114b21c None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.690591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac4297-39b0-4b67-8a5f-bb108114b21c None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.690591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac4297-39b0-4b67-8a5f-bb108114b21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.697597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 939/1905] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:36 2022] DELETE /identity/v3/users/455ed2d90f4f4e0fa2417052b6dd4449 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:36.702952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713a60-bdbb-4f5f-8545-6b0df991c61e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.704025 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713a60-bdbb-4f5f-8545-6b0df991c61e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.704553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713a60-bdbb-4f5f-8545-6b0df991c61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.711794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-c3ac4297-39b0-4b67-8a5f-bb108114b21c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:36.713434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c3ac4297-39b0-4b67-8a5f-bb108114b21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.742634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c0713a60-bdbb-4f5f-8545-6b0df991c61e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:36.743945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c0713a60-bdbb-4f5f-8545-6b0df991c61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.796842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 967/1906] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:36.805722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258c8bf-f771-499f-a9be-67965333c5a1 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.807820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258c8bf-f771-499f-a9be-67965333c5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.808284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258c8bf-f771-499f-a9be-67965333c5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.833532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 940/1907] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:36.837970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e258c8bf-f771-499f-a9be-67965333c5a1 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:36.839017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0713a60-bdbb-4f5f-8545-6b0df991c61e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:36.839787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e258c8bf-f771-499f-a9be-67965333c5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:36.851461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0713a60-bdbb-4f5f-8545-6b0df991c61e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:36.856931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 968/1908] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:36.864313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258c8bf-f771-499f-a9be-67965333c5a1 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:36.867033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:36.876587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258c8bf-f771-499f-a9be-67965333c5a1 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:36.881161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80970b4-6b85-42e3-a225-7c1e1fec4f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:36.881941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80970b4-6b85-42e3-a225-7c1e1fec4f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.882411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80970b4-6b85-42e3-a225-7c1e1fec4f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.882685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80970b4-6b85-42e3-a225-7c1e1fec4f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.883972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80970b4-6b85-42e3-a225-7c1e1fec4f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:36.885053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80970b4-6b85-42e3-a225-7c1e1fec4f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:36.889908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74656262-bb54-4593-becf-860e24836573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:36.890589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74656262-bb54-4593-becf-860e24836573 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.890874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74656262-bb54-4593-becf-860e24836573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.891150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74656262-bb54-4593-becf-860e24836573 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.891870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74656262-bb54-4593-becf-860e24836573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:36.892180 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74656262-bb54-4593-becf-860e24836573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:36.894295 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74656262-bb54-4593-becf-860e24836573 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:36.902979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80970b4-6b85-42e3-a225-7c1e1fec4f3a admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:36.912633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 941/1909] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 02:09:36.917261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74656262-bb54-4593-becf-860e24836573 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:36.929366 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 969/1910] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:36.930209 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74656262-bb54-4593-becf-860e24836573 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:36.933185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80970b4-6b85-42e3-a225-7c1e1fec4f3a admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:36.937630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408086b2-6fb8-495a-8aba-ecbcd1bf91c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:36.938685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408086b2-6fb8-495a-8aba-ecbcd1bf91c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.939058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408086b2-6fb8-495a-8aba-ecbcd1bf91c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.939849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408086b2-6fb8-495a-8aba-ecbcd1bf91c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.940635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408086b2-6fb8-495a-8aba-ecbcd1bf91c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:36.942671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408086b2-6fb8-495a-8aba-ecbcd1bf91c7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:36.952932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80970b4-6b85-42e3-a225-7c1e1fec4f3a admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:36.959819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4e194-ccfe-4400-9a68-2105ea86d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:36.961121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e194-ccfe-4400-9a68-2105ea86d6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:36.961577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e194-ccfe-4400-9a68-2105ea86d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:36.961909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e194-ccfe-4400-9a68-2105ea86d6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:36.962635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4e194-ccfe-4400-9a68-2105ea86d6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:36.966553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4e194-ccfe-4400-9a68-2105ea86d6d7 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:36.990671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 942/1911] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:36 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:09:36.993177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408086b2-6fb8-495a-8aba-ecbcd1bf91c7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:37.005179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 970/1912] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:36 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:37.009509 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4e194-ccfe-4400-9a68-2105ea86d6d7 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:37.104785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408086b2-6fb8-495a-8aba-ecbcd1bf91c7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:37.169614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4e194-ccfe-4400-9a68-2105ea86d6d7 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:37.175094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4f98f-3886-4239-8a63-d2f1978ebcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:37.175989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4f98f-3886-4239-8a63-d2f1978ebcfb admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.176478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4f98f-3886-4239-8a63-d2f1978ebcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.176975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4f98f-3886-4239-8a63-d2f1978ebcfb admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.177903 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4f98f-3886-4239-8a63-d2f1978ebcfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:37.180373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4f98f-3886-4239-8a63-d2f1978ebcfb admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:37.187167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03f601-3a59-4f6f-b549-98e122a504d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:37.187804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f601-3a59-4f6f-b549-98e122a504d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.188086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f601-3a59-4f6f-b549-98e122a504d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.188359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f601-3a59-4f6f-b549-98e122a504d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.189028 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03f601-3a59-4f6f-b549-98e122a504d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:37.191261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03f601-3a59-4f6f-b549-98e122a504d8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:37.212676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 971/1913] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:37 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:37.217046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4f98f-3886-4239-8a63-d2f1978ebcfb admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:37.229604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 943/1914] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:36 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:37.230573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03f601-3a59-4f6f-b549-98e122a504d8 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:37.236777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:37.245069 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03f601-3a59-4f6f-b549-98e122a504d8 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:37.248520 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4f98f-3886-4239-8a63-d2f1978ebcfb admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:37.252141 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a2e19-96f6-4e6c-83fc-9e23c6a91d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:37.253195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2e19-96f6-4e6c-83fc-9e23c6a91d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.253671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2e19-96f6-4e6c-83fc-9e23c6a91d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.253962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2e19-96f6-4e6c-83fc-9e23c6a91d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.255079 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a2e19-96f6-4e6c-83fc-9e23c6a91d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:37.257798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a2e19-96f6-4e6c-83fc-9e23c6a91d8e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:37.260902 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0ed3d-bf80-4be7-a2c2-ab6c73b4e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:37.261748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0ed3d-bf80-4be7-a2c2-ab6c73b4e20c admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.263176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0ed3d-bf80-4be7-a2c2-ab6c73b4e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.264931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0ed3d-bf80-4be7-a2c2-ab6c73b4e20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.268384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0ed3d-bf80-4be7-a2c2-ab6c73b4e20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:37.270215 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0ed3d-bf80-4be7-a2c2-ab6c73b4e20c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:37.279697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 944/1915] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:37.281440 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a2e19-96f6-4e6c-83fc-9e23c6a91d8e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:37.295257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a2e19-96f6-4e6c-83fc-9e23c6a91d8e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:37.302192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d7865-97d9-4d44-9c2b-72f9434ed07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:37.303145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d7865-97d9-4d44-9c2b-72f9434ed07c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.303527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d7865-97d9-4d44-9c2b-72f9434ed07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.303947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d7865-97d9-4d44-9c2b-72f9434ed07c admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.305029 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 972/1916] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:37.308851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d7865-97d9-4d44-9c2b-72f9434ed07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:37.309561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0ed3d-bf80-4be7-a2c2-ab6c73b4e20c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:37.313721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d7865-97d9-4d44-9c2b-72f9434ed07c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:37.334192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 945/1917] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:37.335923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d7865-97d9-4d44-9c2b-72f9434ed07c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:37.346749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0ed3d-bf80-4be7-a2c2-ab6c73b4e20c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:37.350352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d7865-97d9-4d44-9c2b-72f9434ed07c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:37.358549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a0469-f01b-4192-8654-60c82f37d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:37.359087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a0469-f01b-4192-8654-60c82f37d698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.359445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a0469-f01b-4192-8654-60c82f37d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.360127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a0469-f01b-4192-8654-60c82f37d698 admin admin] PATH_INFO: `/v3/projects/e541915b89f846949039eab93a833cdb/users/27be78be366e48f197bb999559c9738b/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.363256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260eb25-1f6a-4e72-a4bb-9798ca59d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:37.365256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260eb25-1f6a-4e72-a4bb-9798ca59d197 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.365746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260eb25-1f6a-4e72-a4bb-9798ca59d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.366995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260eb25-1f6a-4e72-a4bb-9798ca59d197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.368294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260eb25-1f6a-4e72-a4bb-9798ca59d197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:37.373622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260eb25-1f6a-4e72-a4bb-9798ca59d197 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:37.384808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a0469-f01b-4192-8654-60c82f37d698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e541915b89f846949039eab93a833cdb, user_id=27be78be366e48f197bb999559c9738b, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:37.388328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a0469-f01b-4192-8654-60c82f37d698 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:37.399841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 973/1918] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:37.400943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260eb25-1f6a-4e72-a4bb-9798ca59d197 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:37.410210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0260eb25-1f6a-4e72-a4bb-9798ca59d197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:37.425558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260eb25-1f6a-4e72-a4bb-9798ca59d197 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:37.447958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 946/1919] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:37 2022] PUT /identity/v3/projects/e541915b89f846949039eab93a833cdb/users/27be78be366e48f197bb999559c9738b/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:37.449063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a0469-f01b-4192-8654-60c82f37d698 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:37.554249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:37.555759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.556200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.558334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] PATH_INFO: `/v3/projects/118b600874874069947732ab500ff011` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.560116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118b600874874069947732ab500ff011)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:37.563647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:37.567288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a0469-f01b-4192-8654-60c82f37d698 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:37.575333 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1de9c-57ec-4253-be74-0df02148a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:37.576567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1de9c-57ec-4253-be74-0df02148a59b admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.577028 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1de9c-57ec-4253-be74-0df02148a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.577552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1de9c-57ec-4253-be74-0df02148a59b admin admin] PATH_INFO: `/v3/projects/7d60b660f5d645f9b5ca425fdb03e6f0/users/0e4f45eb9db44104885cb68e14db0693/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.604556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1de9c-57ec-4253-be74-0df02148a59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d60b660f5d645f9b5ca425fdb03e6f0, user_id=0e4f45eb9db44104885cb68e14db0693, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:37.608262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1de9c-57ec-4253-be74-0df02148a59b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:37.628266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 947/1920] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:37 2022] PUT /identity/v3/projects/7d60b660f5d645f9b5ca425fdb03e6f0/users/0e4f45eb9db44104885cb68e14db0693/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:37.630216 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91604e3-2a52-4c86-892a-6197a1f631f5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.630661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91604e3-2a52-4c86-892a-6197a1f631f5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.631061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91604e3-2a52-4c86-892a-6197a1f631f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.690534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:37.708182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e91604e3-2a52-4c86-892a-6197a1f631f5 None None] MFA Rules not processed for user `27be78be366e48f197bb999559c9738b`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:37.712205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e91604e3-2a52-4c86-892a-6197a1f631f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:37.726423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118b600874874069947732ab500ff011', 'request_id': 'req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:37.748420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118b600874874069947732ab500ff011', 'request_id': 'req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:37.771545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118b600874874069947732ab500ff011', 'request_id': 'req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:37.803679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] The token cache is being invalidate because project 118b600874874069947732ab500ff011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:37.804502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:37.811925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6cba7e3-fea6-44df-a34c-7e81a1b525d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:37.815332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 974/1921] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:37 2022] DELETE /identity/v3/projects/118b600874874069947732ab500ff011 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:37.822383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55243f1-fb1f-4530-90bf-27f7344bad01 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.824613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55243f1-fb1f-4530-90bf-27f7344bad01 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.824906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55243f1-fb1f-4530-90bf-27f7344bad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.858460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 948/1922] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:37.863004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5dd88-54cb-4764-816e-6c6059a6e729 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:37.863320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5dd88-54cb-4764-816e-6c6059a6e729 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:37.865211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5dd88-54cb-4764-816e-6c6059a6e729 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:37.871373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 949/1923] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:09:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:09:37.872272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5dd88-54cb-4764-816e-6c6059a6e729 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:37.880048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cbd5dd88-54cb-4764-816e-6c6059a6e729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:37.905164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f55243f1-fb1f-4530-90bf-27f7344bad01 None None] MFA Rules not processed for user `0e4f45eb9db44104885cb68e14db0693`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:37.908354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f55243f1-fb1f-4530-90bf-27f7344bad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:37.932052 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:38.041329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5dd88-54cb-4764-816e-6c6059a6e729 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:38.050950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:38.051711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.052066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.052420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] PATH_INFO: `/v3/users/316e4289c88d43839f24c5efb9590498` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.053941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=316e4289c88d43839f24c5efb9590498)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:38.058043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:38.069192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 975/1924] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:38.070417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55243f1-fb1f-4530-90bf-27f7344bad01 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:38.074717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f55243f1-fb1f-4530-90bf-27f7344bad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.143650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316e4289c88d43839f24c5efb9590498'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.144978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316e4289c88d43839f24c5efb9590498'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.160515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316e4289c88d43839f24c5efb9590498'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.173755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55243f1-fb1f-4530-90bf-27f7344bad01 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:38.182387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316e4289c88d43839f24c5efb9590498'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.183316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da69a0f7-3054-4caa-89b5-e8c6b48a9db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316e4289c88d43839f24c5efb9590498'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.183564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6501cbc-4ba5-45de-a18d-dbaf5357b00d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:38.184268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6501cbc-4ba5-45de-a18d-dbaf5357b00d service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.184694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6501cbc-4ba5-45de-a18d-dbaf5357b00d service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.184981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6501cbc-4ba5-45de-a18d-dbaf5357b00d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.186967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d6501cbc-4ba5-45de-a18d-dbaf5357b00d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.202783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 950/1925] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:37 2022] DELETE /identity/v3/users/316e4289c88d43839f24c5efb9590498 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:38.204240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51b5c2-3157-45d4-9a1b-ed010e82b0e4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.204560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51b5c2-3157-45d4-9a1b-ed010e82b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.204801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51b5c2-3157-45d4-9a1b-ed010e82b0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.209465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6501cbc-4ba5-45de-a18d-dbaf5357b00d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:38.213027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6501cbc-4ba5-45de-a18d-dbaf5357b00d service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:38.233555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3d51b5c2-3157-45d4-9a1b-ed010e82b0e4 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:38.235028 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 976/1926] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:38.235933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6501cbc-4ba5-45de-a18d-dbaf5357b00d service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:38.241071 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d6501cbc-4ba5-45de-a18d-dbaf5357b00d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.250109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3d51b5c2-3157-45d4-9a1b-ed010e82b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.268550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6501cbc-4ba5-45de-a18d-dbaf5357b00d service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:38.380202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d7bf7-9acc-484d-83da-902b526f919d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:38.380841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d7bf7-9acc-484d-83da-902b526f919d service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.381122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d7bf7-9acc-484d-83da-902b526f919d service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.381393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d7bf7-9acc-484d-83da-902b526f919d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.383357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-755d7bf7-9acc-484d-83da-902b526f919d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.396463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 951/1927] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:09:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:38.397331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51b5c2-3157-45d4-9a1b-ed010e82b0e4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:38.402294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3d51b5c2-3157-45d4-9a1b-ed010e82b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.403018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:38.498632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:38.517119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d7bf7-9acc-484d-83da-902b526f919d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:38.518613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d7bf7-9acc-484d-83da-902b526f919d service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:38.534572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51b5c2-3157-45d4-9a1b-ed010e82b0e4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:38.541904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:38.542909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.543185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.543542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] PATH_INFO: `/v3/projects/2a4314e8026f4b9882c697eeb1bc1a43` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.545526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4314e8026f4b9882c697eeb1bc1a43)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:38.547059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 977/1928] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:38.548042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d7bf7-9acc-484d-83da-902b526f919d service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:38.548206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:38.552647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-755d7bf7-9acc-484d-83da-902b526f919d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.575222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d7bf7-9acc-484d-83da-902b526f919d service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:38.581461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f9e75-6482-480b-9af0-a653f7590a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:38.582144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f9e75-6482-480b-9af0-a653f7590a55 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.582540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f9e75-6482-480b-9af0-a653f7590a55 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.582881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f9e75-6482-480b-9af0-a653f7590a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.592966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f9e75-6482-480b-9af0-a653f7590a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:38.594843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f9e75-6482-480b-9af0-a653f7590a55 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:38.608271 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 978/1929] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:38.617928 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4314e8026f4b9882c697eeb1bc1a43', 'request_id': 'req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.622524 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f9e75-6482-480b-9af0-a653f7590a55 service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:38.625723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4314e8026f4b9882c697eeb1bc1a43', 'request_id': 'req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.626919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f12f9e75-6482-480b-9af0-a653f7590a55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.633182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4314e8026f4b9882c697eeb1bc1a43', 'request_id': 'req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.652337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] The token cache is being invalidate because project 2a4314e8026f4b9882c697eeb1bc1a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:38.652601 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.653442 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0dd0b5bd-3ddf-49f2-ba6a-beeaf77053ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.655273 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 952/1930] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:38 2022] DELETE /identity/v3/projects/2a4314e8026f4b9882c697eeb1bc1a43 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:38.662713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd583d5-5bf2-4bfd-91c9-b3e100926c96 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.663002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd583d5-5bf2-4bfd-91c9-b3e100926c96 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.664008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd583d5-5bf2-4bfd-91c9-b3e100926c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.674979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f9e75-6482-480b-9af0-a653f7590a55 service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:38.702654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0dd583d5-5bf2-4bfd-91c9-b3e100926c96 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:38.703980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0dd583d5-5bf2-4bfd-91c9-b3e100926c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.797550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:38.798207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.799100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.799100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] PATH_INFO: `/v3/users/0e4f45eb9db44104885cb68e14db0693` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.799976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4f45eb9db44104885cb68e14db0693)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:38.801912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:38.817588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 953/1931] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:38.829431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd583d5-5bf2-4bfd-91c9-b3e100926c96 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:38.831343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0dd583d5-5bf2-4bfd-91c9-b3e100926c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.848806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd583d5-5bf2-4bfd-91c9-b3e100926c96 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:38.855643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:38.856251 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.856728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.857011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] PATH_INFO: `/v3/projects/e4083fb8ec8041249362fabf3d9b884f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.858196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4083fb8ec8041249362fabf3d9b884f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:38.860737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:38.869441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4f45eb9db44104885cb68e14db0693'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.872297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4f45eb9db44104885cb68e14db0693'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.883343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4f45eb9db44104885cb68e14db0693'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.898953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4f45eb9db44104885cb68e14db0693'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.899773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6612c9f1-1614-4dc0-bfad-212defa9da99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4f45eb9db44104885cb68e14db0693'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.915026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 979/1932] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:38 2022] DELETE /identity/v3/users/0e4f45eb9db44104885cb68e14db0693 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:38.916699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256484-fbf6-494f-b682-5d9a98070981 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.917199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256484-fbf6-494f-b682-5d9a98070981 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.917578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256484-fbf6-494f-b682-5d9a98070981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.923592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4083fb8ec8041249362fabf3d9b884f', 'request_id': 'req-b0e1f343-f33b-4446-b1cc-d253980c5bff'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.930632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4083fb8ec8041249362fabf3d9b884f', 'request_id': 'req-b0e1f343-f33b-4446-b1cc-d253980c5bff'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.936789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-47256484-fbf6-494f-b682-5d9a98070981 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:38.936919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4083fb8ec8041249362fabf3d9b884f', 'request_id': 'req-b0e1f343-f33b-4446-b1cc-d253980c5bff'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.937984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-47256484-fbf6-494f-b682-5d9a98070981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:38.939375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:38.954271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] The token cache is being invalidate because project e4083fb8ec8041249362fabf3d9b884f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:38.954432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:38.954576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.955257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b0e1f343-f33b-4446-b1cc-d253980c5bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:38.957091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 954/1933] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:38 2022] DELETE /identity/v3/projects/e4083fb8ec8041249362fabf3d9b884f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:38.958348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b194e4e-d4d7-48d1-b9fd-da06c2253057 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:38.958662 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b194e4e-d4d7-48d1-b9fd-da06c2253057 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:38.958979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b194e4e-d4d7-48d1-b9fd-da06c2253057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:38.979804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9b194e4e-d4d7-48d1-b9fd-da06c2253057 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:38.980995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9b194e4e-d4d7-48d1-b9fd-da06c2253057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:39.006140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 980/1934] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:39.008145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dddde-5429-4e5a-914a-3537b30a6edc None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.008425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dddde-5429-4e5a-914a-3537b30a6edc None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.008693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dddde-5429-4e5a-914a-3537b30a6edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.027611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-293dddde-5429-4e5a-914a-3537b30a6edc None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:39.028784 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-293dddde-5429-4e5a-914a-3537b30a6edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:39.036642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 981/1935] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:39.037557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dddde-5429-4e5a-914a-3537b30a6edc None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.046075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 955/1936] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:39.046075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cdd2c-5a43-4cf7-acac-6fdde09e3081 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.046366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cdd2c-5a43-4cf7-acac-6fdde09e3081 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.046587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cdd2c-5a43-4cf7-acac-6fdde09e3081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.052315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dddde-5429-4e5a-914a-3537b30a6edc None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.057219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3289e6e-da6e-4a60-bfbf-4e0f310847e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.057894 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289e6e-da6e-4a60-bfbf-4e0f310847e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.058192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289e6e-da6e-4a60-bfbf-4e0f310847e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.058491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289e6e-da6e-4a60-bfbf-4e0f310847e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.059260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3289e6e-da6e-4a60-bfbf-4e0f310847e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:39.059608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3289e6e-da6e-4a60-bfbf-4e0f310847e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.061342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3289e6e-da6e-4a60-bfbf-4e0f310847e7 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.069038 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-834cdd2c-5a43-4cf7-acac-6fdde09e3081 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:39.070955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-834cdd2c-5a43-4cf7-acac-6fdde09e3081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:39.073883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 982/1937] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:39.074769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3289e6e-da6e-4a60-bfbf-4e0f310847e7 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.076332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e3289e6e-da6e-4a60-bfbf-4e0f310847e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:39.083208 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 956/1938] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:39.084138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cdd2c-5a43-4cf7-acac-6fdde09e3081 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.097434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cdd2c-5a43-4cf7-acac-6fdde09e3081 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.102899 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459a0f6-92f9-4c87-9667-a6f010b7a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.103533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459a0f6-92f9-4c87-9667-a6f010b7a2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.103818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459a0f6-92f9-4c87-9667-a6f010b7a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.104081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459a0f6-92f9-4c87-9667-a6f010b7a2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.104747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459a0f6-92f9-4c87-9667-a6f010b7a2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.106697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459a0f6-92f9-4c87-9667-a6f010b7a2f1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.134073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3289e6e-da6e-4a60-bfbf-4e0f310847e7 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.136288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 957/1939] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:39 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:39.137114 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459a0f6-92f9-4c87-9667-a6f010b7a2f1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.137806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2266417-ec16-4e8f-9119-08e759ff2f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.138412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2266417-ec16-4e8f-9119-08e759ff2f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.138735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2266417-ec16-4e8f-9119-08e759ff2f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.138992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2266417-ec16-4e8f-9119-08e759ff2f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.148490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2266417-ec16-4e8f-9119-08e759ff2f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.149926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2266417-ec16-4e8f-9119-08e759ff2f9d service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.159504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 983/1940] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:39.160340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2266417-ec16-4e8f-9119-08e759ff2f9d service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.169308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2266417-ec16-4e8f-9119-08e759ff2f9d service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.205194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459a0f6-92f9-4c87-9667-a6f010b7a2f1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.210695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98982a9f-4f05-4daf-813a-0a622f7f024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.211108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98982a9f-4f05-4daf-813a-0a622f7f024a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.211393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98982a9f-4f05-4daf-813a-0a622f7f024a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.211669 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98982a9f-4f05-4daf-813a-0a622f7f024a admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.212402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98982a9f-4f05-4daf-813a-0a622f7f024a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:39.212858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98982a9f-4f05-4daf-813a-0a622f7f024a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.214494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98982a9f-4f05-4daf-813a-0a622f7f024a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.230958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 958/1941] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:39.231905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98982a9f-4f05-4daf-813a-0a622f7f024a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.233917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dde446-1d67-4877-8301-81ee2a8e13a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.234615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dde446-1d67-4877-8301-81ee2a8e13a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.235042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dde446-1d67-4877-8301-81ee2a8e13a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.235317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dde446-1d67-4877-8301-81ee2a8e13a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.236069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dde446-1d67-4877-8301-81ee2a8e13a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.238268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dde446-1d67-4877-8301-81ee2a8e13a1 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.244852 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98982a9f-4f05-4daf-813a-0a622f7f024a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.252099 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606adf-5936-416f-b0fc-7616857e8598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.253269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606adf-5936-416f-b0fc-7616857e8598 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.253769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606adf-5936-416f-b0fc-7616857e8598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.254183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606adf-5936-416f-b0fc-7616857e8598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.254913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2606adf-5936-416f-b0fc-7616857e8598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.257947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2606adf-5936-416f-b0fc-7616857e8598 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.271727 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 984/1942] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:39 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:39.275479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dde446-1d67-4877-8301-81ee2a8e13a1 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.288560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dde446-1d67-4877-8301-81ee2a8e13a1 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.295237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8c144-19e2-4a25-af00-d18abaf1f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.296527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8c144-19e2-4a25-af00-d18abaf1f86e admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.296919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8c144-19e2-4a25-af00-d18abaf1f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.297265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8c144-19e2-4a25-af00-d18abaf1f86e admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.298046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8c144-19e2-4a25-af00-d18abaf1f86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.299889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8c144-19e2-4a25-af00-d18abaf1f86e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.300109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 959/1943] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:39 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:39.303588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606adf-5936-416f-b0fc-7616857e8598 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.318753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 985/1944] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:39.320899 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8c144-19e2-4a25-af00-d18abaf1f86e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.338239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8c144-19e2-4a25-af00-d18abaf1f86e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.367126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:39.393265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:39.425004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d247c4-1f6b-4414-8833-b34690bf550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.425791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d247c4-1f6b-4414-8833-b34690bf550b admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.426117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d247c4-1f6b-4414-8833-b34690bf550b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.426396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d247c4-1f6b-4414-8833-b34690bf550b admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.427137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d247c4-1f6b-4414-8833-b34690bf550b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.427724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606adf-5936-416f-b0fc-7616857e8598 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.429350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d247c4-1f6b-4414-8833-b34690bf550b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.437638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b06e5-6dbe-4b53-819a-25120edb7549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.438703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b06e5-6dbe-4b53-819a-25120edb7549 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.439075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b06e5-6dbe-4b53-819a-25120edb7549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.439737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b06e5-6dbe-4b53-819a-25120edb7549 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.441468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b06e5-6dbe-4b53-819a-25120edb7549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.445285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b06e5-6dbe-4b53-819a-25120edb7549 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.447774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 986/1945] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:39.449077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d247c4-1f6b-4414-8833-b34690bf550b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.465536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d247c4-1f6b-4414-8833-b34690bf550b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.480564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 960/1946] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:39 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:09:39.485134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b06e5-6dbe-4b53-819a-25120edb7549 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.486911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d914f5-10b7-44a6-86bf-964b63f96133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.487600 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d914f5-10b7-44a6-86bf-964b63f96133 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.487883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d914f5-10b7-44a6-86bf-964b63f96133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.488162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d914f5-10b7-44a6-86bf-964b63f96133 admin admin] PATH_INFO: `/v3/projects/817f06bf82b24c4f8fa24fef27ee5910/users/3fa4d9f8f2fb4a739f369ad3f0702752/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.502133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b06e5-6dbe-4b53-819a-25120edb7549 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.510819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba37cc-a4c3-44fc-a949-f0ac5a485a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.511506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba37cc-a4c3-44fc-a949-f0ac5a485a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.511945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba37cc-a4c3-44fc-a949-f0ac5a485a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.512322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba37cc-a4c3-44fc-a949-f0ac5a485a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.513546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba37cc-a4c3-44fc-a949-f0ac5a485a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.516514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba37cc-a4c3-44fc-a949-f0ac5a485a3f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.519341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d914f5-10b7-44a6-86bf-964b63f96133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817f06bf82b24c4f8fa24fef27ee5910, user_id=3fa4d9f8f2fb4a739f369ad3f0702752, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.523451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d914f5-10b7-44a6-86bf-964b63f96133 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.532839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 961/1947] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:39.534886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba37cc-a4c3-44fc-a949-f0ac5a485a3f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.549069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 987/1948] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:39 2022] PUT /identity/v3/projects/817f06bf82b24c4f8fa24fef27ee5910/users/3fa4d9f8f2fb4a739f369ad3f0702752/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:39.560350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba37cc-a4c3-44fc-a949-f0ac5a485a3f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.563943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d740-98bc-44bb-aa9e-b715bc1f5005 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.564260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d740-98bc-44bb-aa9e-b715bc1f5005 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.565003 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d740-98bc-44bb-aa9e-b715bc1f5005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.605753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-55f0d740-98bc-44bb-aa9e-b715bc1f5005 None None] MFA Rules not processed for user `3fa4d9f8f2fb4a739f369ad3f0702752`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:39.608112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-55f0d740-98bc-44bb-aa9e-b715bc1f5005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:39.651162 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0436b-9642-4398-b1f2-1e300aa2281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.660935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0436b-9642-4398-b1f2-1e300aa2281f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.661398 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0436b-9642-4398-b1f2-1e300aa2281f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.661743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0436b-9642-4398-b1f2-1e300aa2281f admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.662604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0436b-9642-4398-b1f2-1e300aa2281f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.666933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0436b-9642-4398-b1f2-1e300aa2281f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.691827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 962/1949] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:39.692856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0436b-9642-4398-b1f2-1e300aa2281f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.695654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f4e0436b-9642-4398-b1f2-1e300aa2281f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:39.709720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0436b-9642-4398-b1f2-1e300aa2281f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.715876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.716535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.716818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.717093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] PATH_INFO: `/v3/projects/7d60b660f5d645f9b5ca425fdb03e6f0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.718963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d60b660f5d645f9b5ca425fdb03e6f0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.722260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.748451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 988/1950] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:39.749326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d740-98bc-44bb-aa9e-b715bc1f5005 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.766722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d740-98bc-44bb-aa9e-b715bc1f5005 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:39.774653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63571083-93e4-4bb0-96c9-3913419c35fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:39.775344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63571083-93e4-4bb0-96c9-3913419c35fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.775671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63571083-93e4-4bb0-96c9-3913419c35fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.775951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63571083-93e4-4bb0-96c9-3913419c35fc admin admin] PATH_INFO: `/v3/projects/7321310f3d1446ad90071920f71742be/users/e0a1ad39aa6747cb957cf596cc2a13f4/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.791581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d60b660f5d645f9b5ca425fdb03e6f0', 'request_id': 'req-26ce0939-adcc-4653-b8fd-d14626d3598d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:39.801773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d60b660f5d645f9b5ca425fdb03e6f0', 'request_id': 'req-26ce0939-adcc-4653-b8fd-d14626d3598d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:39.816815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d60b660f5d645f9b5ca425fdb03e6f0', 'request_id': 'req-26ce0939-adcc-4653-b8fd-d14626d3598d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:39.832144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63571083-93e4-4bb0-96c9-3913419c35fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7321310f3d1446ad90071920f71742be, user_id=e0a1ad39aa6747cb957cf596cc2a13f4, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:39.844925 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] The token cache is being invalidate because project 7d60b660f5d645f9b5ca425fdb03e6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:39.845226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:39.846570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63571083-93e4-4bb0-96c9-3913419c35fc admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:39.849179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:39.852015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 963/1951] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:39 2022] DELETE /identity/v3/projects/7d60b660f5d645f9b5ca425fdb03e6f0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:39.852788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:39.868266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:39.886818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 989/1952] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:39 2022] PUT /identity/v3/projects/7321310f3d1446ad90071920f71742be/users/e0a1ad39aa6747cb957cf596cc2a13f4/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:39.888516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268ac1-f366-4fd4-be95-d35ad07bc6d0 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:39.888806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268ac1-f366-4fd4-be95-d35ad07bc6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:39.889084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268ac1-f366-4fd4-be95-d35ad07bc6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:39.958943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-45268ac1-f366-4fd4-be95-d35ad07bc6d0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:39.964672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-45268ac1-f366-4fd4-be95-d35ad07bc6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:39.990671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:40.054019 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce0939-adcc-4653-b8fd-d14626d3598d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.065580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:40.084248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 990/1953] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:40.087013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b87610-acd2-4514-9e86-926fc89785b8 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.087593 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b87610-acd2-4514-9e86-926fc89785b8 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.088068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b87610-acd2-4514-9e86-926fc89785b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.133923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-56b87610-acd2-4514-9e86-926fc89785b8 None None] MFA Rules not processed for user `e0a1ad39aa6747cb957cf596cc2a13f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:40.137045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1176ec6-0988-4ee7-98e0-cdac04b5d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.137217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-56b87610-acd2-4514-9e86-926fc89785b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:40.137621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176ec6-0988-4ee7-98e0-cdac04b5d66b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.138045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176ec6-0988-4ee7-98e0-cdac04b5d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.138651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176ec6-0988-4ee7-98e0-cdac04b5d66b admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.139027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1176ec6-0988-4ee7-98e0-cdac04b5d66b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.141941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1176ec6-0988-4ee7-98e0-cdac04b5d66b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.187467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 964/1954] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:39 2022] POST /identity/v3/projects => generated 383 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:40.189053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd30c-10a2-4d59-952f-5fa3c3246ccb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.189705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd30c-10a2-4d59-952f-5fa3c3246ccb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.189981 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd30c-10a2-4d59-952f-5fa3c3246ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.238839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-200bd30c-10a2-4d59-952f-5fa3c3246ccb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:40.240076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-200bd30c-10a2-4d59-952f-5fa3c3246ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:40.256585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 991/1955] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:40.257768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b87610-acd2-4514-9e86-926fc89785b8 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.271489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b87610-acd2-4514-9e86-926fc89785b8 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.330987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 965/1956] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:40.332318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd30c-10a2-4d59-952f-5fa3c3246ccb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.336215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-200bd30c-10a2-4d59-952f-5fa3c3246ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:40.341618 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82712c09-f9f4-4035-8a02-2ec09567f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.342247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82712c09-f9f4-4035-8a02-2ec09567f86e admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.342900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82712c09-f9f4-4035-8a02-2ec09567f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.342900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82712c09-f9f4-4035-8a02-2ec09567f86e admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.343591 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82712c09-f9f4-4035-8a02-2ec09567f86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.345550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82712c09-f9f4-4035-8a02-2ec09567f86e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.354253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd30c-10a2-4d59-952f-5fa3c3246ccb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.359318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92c4d6-2e31-4da6-8321-c3e192ccdfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.359937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c4d6-2e31-4da6-8321-c3e192ccdfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.360325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c4d6-2e31-4da6-8321-c3e192ccdfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.360480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c4d6-2e31-4da6-8321-c3e192ccdfc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.361141 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92c4d6-2e31-4da6-8321-c3e192ccdfc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.363077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92c4d6-2e31-4da6-8321-c3e192ccdfc1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.369654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 992/1957] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:40 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:40.370432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82712c09-f9f4-4035-8a02-2ec09567f86e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.380881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82712c09-f9f4-4035-8a02-2ec09567f86e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.386984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220ebeb-03c2-40df-b9ca-e9ec5a500ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.387713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ebeb-03c2-40df-b9ca-e9ec5a500ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.388053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ebeb-03c2-40df-b9ca-e9ec5a500ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.388336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ebeb-03c2-40df-b9ca-e9ec5a500ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.389037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220ebeb-03c2-40df-b9ca-e9ec5a500ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:40.389340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220ebeb-03c2-40df-b9ca-e9ec5a500ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.390969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220ebeb-03c2-40df-b9ca-e9ec5a500ef6 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.393063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 966/1958] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:40 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:40.393883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92c4d6-2e31-4da6-8321-c3e192ccdfc1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.407152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 993/1959] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:40.407152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220ebeb-03c2-40df-b9ca-e9ec5a500ef6 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.414011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220ebeb-03c2-40df-b9ca-e9ec5a500ef6 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.447116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:40.463098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92c4d6-2e31-4da6-8321-c3e192ccdfc1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.467711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdca052-0131-4cdb-a7db-bb6fa3349742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.468361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca052-0131-4cdb-a7db-bb6fa3349742 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.468642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca052-0131-4cdb-a7db-bb6fa3349742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.468915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca052-0131-4cdb-a7db-bb6fa3349742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.469602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdca052-0131-4cdb-a7db-bb6fa3349742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.471233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdca052-0131-4cdb-a7db-bb6fa3349742 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.472416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38539-d2e9-4c98-b19f-cb4e3559451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.473305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38539-d2e9-4c98-b19f-cb4e3559451f admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.473305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38539-d2e9-4c98-b19f-cb4e3559451f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.473580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38539-d2e9-4c98-b19f-cb4e3559451f admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.474241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a38539-d2e9-4c98-b19f-cb4e3559451f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.476236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a38539-d2e9-4c98-b19f-cb4e3559451f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.481078 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 967/1960] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:40.481836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdca052-0131-4cdb-a7db-bb6fa3349742 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.487533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:40.491574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdca052-0131-4cdb-a7db-bb6fa3349742 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.496530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3a8c5-e210-4119-8174-a3ad1c99b6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.497117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3a8c5-e210-4119-8174-a3ad1c99b6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.497394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3a8c5-e210-4119-8174-a3ad1c99b6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.497688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3a8c5-e210-4119-8174-a3ad1c99b6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.498363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3a8c5-e210-4119-8174-a3ad1c99b6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.499613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 994/1961] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:40 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:40.500264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3a8c5-e210-4119-8174-a3ad1c99b6b1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.500431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38539-d2e9-4c98-b19f-cb4e3559451f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.510699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38539-d2e9-4c98-b19f-cb4e3559451f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.515318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7d611-e190-480d-8f41-3f72486e6d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.515961 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7d611-e190-480d-8f41-3f72486e6d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.516245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7d611-e190-480d-8f41-3f72486e6d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.516545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7d611-e190-480d-8f41-3f72486e6d97 admin admin] PATH_INFO: `/v3/projects/6465b7727e7c4ed8bcdfc4605f61ad60/users/7875dcc13ed84d568121da68e08a9f28/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.528226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 968/1962] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:40 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:40.529148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3a8c5-e210-4119-8174-a3ad1c99b6b1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.535181 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7d611-e190-480d-8f41-3f72486e6d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6465b7727e7c4ed8bcdfc4605f61ad60, user_id=7875dcc13ed84d568121da68e08a9f28, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.537935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7d611-e190-480d-8f41-3f72486e6d97 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.553067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 995/1963] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:40 2022] PUT /identity/v3/projects/6465b7727e7c4ed8bcdfc4605f61ad60/users/7875dcc13ed84d568121da68e08a9f28/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:40.554118 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7d611-e190-480d-8f41-3f72486e6d97 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.590645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3a8c5-e210-4119-8174-a3ad1c99b6b1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.617621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7d611-e190-480d-8f41-3f72486e6d97 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.622271 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0517fa-885d-4a24-ae01-9b5f27122e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.622913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0517fa-885d-4a24-ae01-9b5f27122e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.623191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0517fa-885d-4a24-ae01-9b5f27122e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.623469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0517fa-885d-4a24-ae01-9b5f27122e53 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.624126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0517fa-885d-4a24-ae01-9b5f27122e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.626030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0517fa-885d-4a24-ae01-9b5f27122e53 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.647936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7087-2a91-4fba-9232-165fb3ebb524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.651119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 996/1964] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:40 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:40.651223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7087-2a91-4fba-9232-165fb3ebb524 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.651223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7087-2a91-4fba-9232-165fb3ebb524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.651482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0517fa-885d-4a24-ae01-9b5f27122e53 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.651572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7087-2a91-4fba-9232-165fb3ebb524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.651572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d7087-2a91-4fba-9232-165fb3ebb524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.651572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d7087-2a91-4fba-9232-165fb3ebb524 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.658580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0517fa-885d-4a24-ae01-9b5f27122e53 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.662008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 969/1965] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:40.662844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7087-2a91-4fba-9232-165fb3ebb524 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.666037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b01cf9-dc1a-4270-898e-84151a1c7965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.666684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b01cf9-dc1a-4270-898e-84151a1c7965 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.667023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b01cf9-dc1a-4270-898e-84151a1c7965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.667649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b01cf9-dc1a-4270-898e-84151a1c7965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.668432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b01cf9-dc1a-4270-898e-84151a1c7965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.670226 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b01cf9-dc1a-4270-898e-84151a1c7965 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.679462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7087-2a91-4fba-9232-165fb3ebb524 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.682043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 997/1966] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:40.682965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b01cf9-dc1a-4270-898e-84151a1c7965 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.686003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63226bb-937c-41e3-977d-8f9b89f6a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.686663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63226bb-937c-41e3-977d-8f9b89f6a113 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.686944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63226bb-937c-41e3-977d-8f9b89f6a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.687217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63226bb-937c-41e3-977d-8f9b89f6a113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.687911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63226bb-937c-41e3-977d-8f9b89f6a113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.689799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63226bb-937c-41e3-977d-8f9b89f6a113 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.693239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b01cf9-dc1a-4270-898e-84151a1c7965 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.698676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5d774-8f94-436a-a8d9-b0cf1baf3529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.699639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5d774-8f94-436a-a8d9-b0cf1baf3529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.699639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5d774-8f94-436a-a8d9-b0cf1baf3529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.699850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5d774-8f94-436a-a8d9-b0cf1baf3529 admin admin] PATH_INFO: `/v3/projects/b4b52866317248f0a36c3e61fcc513cf/users/a46d91b2bb554f75831eb3142e44287b/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.704230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 970/1967] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:40.704230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63226bb-937c-41e3-977d-8f9b89f6a113 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.713794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63226bb-937c-41e3-977d-8f9b89f6a113 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.716425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5d774-8f94-436a-a8d9-b0cf1baf3529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b52866317248f0a36c3e61fcc513cf, user_id=a46d91b2bb554f75831eb3142e44287b, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.718760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3a88f-10eb-4a4f-89f6-add460c4f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.719301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5d774-8f94-436a-a8d9-b0cf1baf3529 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.719422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3a88f-10eb-4a4f-89f6-add460c4f2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.719678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3a88f-10eb-4a4f-89f6-add460c4f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.719950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3a88f-10eb-4a4f-89f6-add460c4f2ba admin admin] PATH_INFO: `/v3/projects/6465b7727e7c4ed8bcdfc4605f61ad60/users/7875dcc13ed84d568121da68e08a9f28/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.721945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3a88f-10eb-4a4f-89f6-add460c4f2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6465b7727e7c4ed8bcdfc4605f61ad60, user_id=7875dcc13ed84d568121da68e08a9f28, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.724762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3a88f-10eb-4a4f-89f6-add460c4f2ba admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.734176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 998/1968] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:40 2022] PUT /identity/v3/projects/b4b52866317248f0a36c3e61fcc513cf/users/a46d91b2bb554f75831eb3142e44287b/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:40.735005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5d774-8f94-436a-a8d9-b0cf1baf3529 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.737665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 971/1969] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:40 2022] PUT /identity/v3/projects/6465b7727e7c4ed8bcdfc4605f61ad60/users/7875dcc13ed84d568121da68e08a9f28/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:40.746583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3a88f-10eb-4a4f-89f6-add460c4f2ba admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.799370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:40.824454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3a88f-10eb-4a4f-89f6-add460c4f2ba admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.829455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5178-7b66-496d-9655-119bf5fd77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.829964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5178-7b66-496d-9655-119bf5fd77f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.830243 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5178-7b66-496d-9655-119bf5fd77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.831652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5178-7b66-496d-9655-119bf5fd77f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.831652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5178-7b66-496d-9655-119bf5fd77f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.833361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5178-7b66-496d-9655-119bf5fd77f7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.835856 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5d774-8f94-436a-a8d9-b0cf1baf3529 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.841687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54134ad1-21a1-4d67-8915-36632b3ac144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.842425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54134ad1-21a1-4d67-8915-36632b3ac144 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.842845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54134ad1-21a1-4d67-8915-36632b3ac144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.843218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54134ad1-21a1-4d67-8915-36632b3ac144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.844192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54134ad1-21a1-4d67-8915-36632b3ac144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.844532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 972/1970] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:40.846054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6c6d7-7723-459f-9b1c-bf1e6d7c76ba None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.846349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54134ad1-21a1-4d67-8915-36632b3ac144 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.846568 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6c6d7-7723-459f-9b1c-bf1e6d7c76ba None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.846776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6c6d7-7723-459f-9b1c-bf1e6d7c76ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.863974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 999/1971] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:40.865067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54134ad1-21a1-4d67-8915-36632b3ac144 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.883045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54134ad1-21a1-4d67-8915-36632b3ac144 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:40.888557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae373de-8d3c-4d74-951f-78a432503285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:40.889225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae373de-8d3c-4d74-951f-78a432503285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.889509 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae373de-8d3c-4d74-951f-78a432503285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.889785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae373de-8d3c-4d74-951f-78a432503285 admin admin] PATH_INFO: `/v3/projects/b4b52866317248f0a36c3e61fcc513cf/users/a46d91b2bb554f75831eb3142e44287b/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.890944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f7c6c6d7-7723-459f-9b1c-bf1e6d7c76ba None None] MFA Rules not processed for user `7875dcc13ed84d568121da68e08a9f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:40.891823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae373de-8d3c-4d74-951f-78a432503285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b52866317248f0a36c3e61fcc513cf, user_id=a46d91b2bb554f75831eb3142e44287b, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:40.892306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f7c6c6d7-7723-459f-9b1c-bf1e6d7c76ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:40.894829 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae373de-8d3c-4d74-951f-78a432503285 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:40.907534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1000/1972] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:40 2022] PUT /identity/v3/projects/b4b52866317248f0a36c3e61fcc513cf/users/a46d91b2bb554f75831eb3142e44287b/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:40.908286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae373de-8d3c-4d74-951f-78a432503285 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:40.924572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:40.983869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 973/1973] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:40.985131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ba9f-bbc1-4638-9df1-e1d03742aacf None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:40.985423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ba9f-bbc1-4638-9df1-e1d03742aacf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:40.985698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ba9f-bbc1-4638-9df1-e1d03742aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:40.995821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae373de-8d3c-4d74-951f-78a432503285 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:41.001274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2bf3a-7fd6-4e78-a689-0e313f2cf784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:41.002354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2bf3a-7fd6-4e78-a689-0e313f2cf784 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:41.002661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2bf3a-7fd6-4e78-a689-0e313f2cf784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:41.002941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2bf3a-7fd6-4e78-a689-0e313f2cf784 admin admin] PATH_INFO: `/v3/projects/b323607668d7461ea435faac291e9fca/users/fa7132650cb24a23a6c17b726734ec11/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:41.015744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0444ba9f-bbc1-4638-9df1-e1d03742aacf None None] MFA Rules not processed for user `a46d91b2bb554f75831eb3142e44287b`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:41.016909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2bf3a-7fd6-4e78-a689-0e313f2cf784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b323607668d7461ea435faac291e9fca, user_id=fa7132650cb24a23a6c17b726734ec11, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:41.017112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0444ba9f-bbc1-4638-9df1-e1d03742aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:41.019693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2bf3a-7fd6-4e78-a689-0e313f2cf784 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:41.033301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1001/1974] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:40 2022] PUT /identity/v3/projects/b323607668d7461ea435faac291e9fca/users/fa7132650cb24a23a6c17b726734ec11/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:41.034332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2bf3a-7fd6-4e78-a689-0e313f2cf784 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:41.035906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0ff2bf3a-7fd6-4e78-a689-0e313f2cf784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:41.094778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 974/1975] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:41.095534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2bf3a-7fd6-4e78-a689-0e313f2cf784 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:41.096329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb3ff4-7e2e-4774-af08-f8ec8c9802d4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:41.096614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb3ff4-7e2e-4774-af08-f8ec8c9802d4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:41.096884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb3ff4-7e2e-4774-af08-f8ec8c9802d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:41.103405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8b4fb-aba2-4eac-ac39-b590c9af2225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:41.104104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8b4fb-aba2-4eac-ac39-b590c9af2225 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:41.104447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8b4fb-aba2-4eac-ac39-b590c9af2225 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:41.104793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8b4fb-aba2-4eac-ac39-b590c9af2225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:41.129704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0dbb3ff4-7e2e-4774-af08-f8ec8c9802d4 None None] MFA Rules not processed for user `fa7132650cb24a23a6c17b726734ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:41.130944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0dbb3ff4-7e2e-4774-af08-f8ec8c9802d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:41.165020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:41.167299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8b4fb-aba2-4eac-ac39-b590c9af2225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:41.168826 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8b4fb-aba2-4eac-ac39-b590c9af2225 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:41.178753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1002/1976] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:41.181815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8b4fb-aba2-4eac-ac39-b590c9af2225 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:41.183181 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-95b8b4fb-aba2-4eac-ac39-b590c9af2225 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:41.194251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8b4fb-aba2-4eac-ac39-b590c9af2225 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:41.198183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aabd3-ea53-43df-8df9-8f0054441023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:41.198824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aabd3-ea53-43df-8df9-8f0054441023 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:41.199110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aabd3-ea53-43df-8df9-8f0054441023 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:41.199389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aabd3-ea53-43df-8df9-8f0054441023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:41.201218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 975/1977] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:41.235205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb3ff4-7e2e-4774-af08-f8ec8c9802d4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:41.243169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:41.248245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb3ff4-7e2e-4774-af08-f8ec8c9802d4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:41.252696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf9020-7ce4-41a7-9fff-dd88afba212f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:41.253322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf9020-7ce4-41a7-9fff-dd88afba212f service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:41.253666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf9020-7ce4-41a7-9fff-dd88afba212f service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:41.253948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf9020-7ce4-41a7-9fff-dd88afba212f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:41.269026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aabd3-ea53-43df-8df9-8f0054441023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:41.270528 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aabd3-ea53-43df-8df9-8f0054441023 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:41.270805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf9020-7ce4-41a7-9fff-dd88afba212f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:41.275095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf9020-7ce4-41a7-9fff-dd88afba212f service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:41.281161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1003/1978] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:41.301490 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 976/1979] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:09:41.620928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aabd3-ea53-43df-8df9-8f0054441023 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:41.630989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aabd3-ea53-43df-8df9-8f0054441023 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:41.636492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48567422-67c0-48d5-b57a-d8e89ac140a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:41.637205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48567422-67c0-48d5-b57a-d8e89ac140a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:41.637490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48567422-67c0-48d5-b57a-d8e89ac140a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:41.637851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48567422-67c0-48d5-b57a-d8e89ac140a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:41.640037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-48567422-67c0-48d5-b57a-d8e89ac140a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:41.736008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48567422-67c0-48d5-b57a-d8e89ac140a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:41.737035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48567422-67c0-48d5-b57a-d8e89ac140a9 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:41.758781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1004/1980] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:42.109014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf9020-7ce4-41a7-9fff-dd88afba212f service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:42.117708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48567422-67c0-48d5-b57a-d8e89ac140a9 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:42.129121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48567422-67c0-48d5-b57a-d8e89ac140a9 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:42.133802 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9255bfa-9380-431e-94d9-cd9b2c925d99 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46d91b2bb554f75831eb3142e44287b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b52866317248f0a36c3e61fcc513cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:42.134392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9255bfa-9380-431e-94d9-cd9b2c925d99 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:42.134698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9255bfa-9380-431e-94d9-cd9b2c925d99 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:42.140101 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9255bfa-9380-431e-94d9-cd9b2c925d99 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:42.141428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9255bfa-9380-431e-94d9-cd9b2c925d99 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:42.141428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9255bfa-9380-431e-94d9-cd9b2c925d99 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:42.142843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9255bfa-9380-431e-94d9-cd9b2c925d99 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:42.159914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1005/1981] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:42.160801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9255bfa-9380-431e-94d9-cd9b2c925d99 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:42.171318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9255bfa-9380-431e-94d9-cd9b2c925d99 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:42.176496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aba70-e803-49a8-bf25-3530eddf2ae7 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46d91b2bb554f75831eb3142e44287b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b52866317248f0a36c3e61fcc513cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:42.177025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aba70-e803-49a8-bf25-3530eddf2ae7 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:42.177312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aba70-e803-49a8-bf25-3530eddf2ae7 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:42.177590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aba70-e803-49a8-bf25-3530eddf2ae7 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:42.178256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4aba70-e803-49a8-bf25-3530eddf2ae7 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:42.180334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4aba70-e803-49a8-bf25-3530eddf2ae7 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:42.193106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf9020-7ce4-41a7-9fff-dd88afba212f service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:42.198393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:42.199206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:42.199560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:42.199955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] PATH_INFO: `/v3/users/3fa4d9f8f2fb4a739f369ad3f0702752` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:42.201168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa4d9f8f2fb4a739f369ad3f0702752)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:42.203412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:42.218244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1006/1982] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:42 2022] POST /identity/v3/projects => generated 353 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:42.219408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aba70-e803-49a8-bf25-3530eddf2ae7 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:42.280603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa4d9f8f2fb4a739f369ad3f0702752'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:42.281291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa4d9f8f2fb4a739f369ad3f0702752'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:42.289707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa4d9f8f2fb4a739f369ad3f0702752'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:42.292939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aba70-e803-49a8-bf25-3530eddf2ae7 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:42.298095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35663288-43c8-46a7-8269-ac02ec0ee67b tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46d91b2bb554f75831eb3142e44287b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b52866317248f0a36c3e61fcc513cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:42.298777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35663288-43c8-46a7-8269-ac02ec0ee67b tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:42.299064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35663288-43c8-46a7-8269-ac02ec0ee67b tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:42.299346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35663288-43c8-46a7-8269-ac02ec0ee67b tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:42.300049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35663288-43c8-46a7-8269-ac02ec0ee67b tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:42.300358 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35663288-43c8-46a7-8269-ac02ec0ee67b tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:42.301974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35663288-43c8-46a7-8269-ac02ec0ee67b tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:42.302664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa4d9f8f2fb4a739f369ad3f0702752'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:42.303314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa4d9f8f2fb4a739f369ad3f0702752'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:42.313797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1007/1983] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:42.316826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 977/1984] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:42 2022] DELETE /identity/v3/users/3fa4d9f8f2fb4a739f369ad3f0702752 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:42.321708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16d27b-d35a-47f2-83d5-4e8a40f42353 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:42.321996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16d27b-d35a-47f2-83d5-4e8a40f42353 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:42.322687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16d27b-d35a-47f2-83d5-4e8a40f42353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:42.342498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-cc16d27b-d35a-47f2-83d5-4e8a40f42353 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:42.343694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-cc16d27b-d35a-47f2-83d5-4e8a40f42353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:42.357487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:42.358875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:42.377617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:42.410918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:42.416993 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1008/1985] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:42.429702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16d27b-d35a-47f2-83d5-4e8a40f42353 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:42.431654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-cc16d27b-d35a-47f2-83d5-4e8a40f42353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:42.434583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdb9c4-3900-4cd4-b3b8-f4d7eb6aba26 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:42.446912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a46d91b2bb554f75831eb3142e44287b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b52866317248f0a36c3e61fcc513cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:42.447659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:42.448117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:42.448357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] PATH_INFO: `/v3/projects/fb6cc9d55fc34ed587948ba0dd82fc5b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:42.451074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fb6cc9d55fc34ed587948ba0dd82fc5b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:42.452985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:42.512246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16d27b-d35a-47f2-83d5-4e8a40f42353 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:42.519012 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6cc9d55fc34ed587948ba0dd82fc5b', 'request_id': 'req-0bbb8f75-3985-4bb8-bf25-bce274733977'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:42.525882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6cc9d55fc34ed587948ba0dd82fc5b', 'request_id': 'req-0bbb8f75-3985-4bb8-bf25-bce274733977'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:42.535710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6cc9d55fc34ed587948ba0dd82fc5b', 'request_id': 'req-0bbb8f75-3985-4bb8-bf25-bce274733977'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:42.552231 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] The token cache is being invalidate because project fb6cc9d55fc34ed587948ba0dd82fc5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:42.552618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:42.553463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:42.557199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 978/1986] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:42 2022] DELETE /identity/v3/projects/fb6cc9d55fc34ed587948ba0dd82fc5b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:42.575317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31215b-eb65-4ba1-8fb9-2d4ac13b8850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:42.576666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31215b-eb65-4ba1-8fb9-2d4ac13b8850 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:42.576666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31215b-eb65-4ba1-8fb9-2d4ac13b8850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:42.576849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31215b-eb65-4ba1-8fb9-2d4ac13b8850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:42.578711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3e31215b-eb65-4ba1-8fb9-2d4ac13b8850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:42.651771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31215b-eb65-4ba1-8fb9-2d4ac13b8850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:42.653643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31215b-eb65-4ba1-8fb9-2d4ac13b8850 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:42.668845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1009/1987] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:42.841665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:42.844336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:42.874625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb8f75-3985-4bb8-bf25-bce274733977 tempest-VolumeQuotaClassesTest-1549604944 tempest-VolumeQuotaClassesTest-1549604944-project-admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:42.887587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:42.888255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:42.888534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:42.888802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] PATH_INFO: `/v3/users/e0a1ad39aa6747cb957cf596cc2a13f4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:42.892760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a1ad39aa6747cb957cf596cc2a13f4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:42.895940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:42.980171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55766d1d-eefe-4706-a106-033a050fdf65 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:42.980467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55766d1d-eefe-4706-a106-033a050fdf65 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:42.981238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55766d1d-eefe-4706-a106-033a050fdf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:43.017140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-55766d1d-eefe-4706-a106-033a050fdf65 None None] MFA Rules not processed for user `fa7132650cb24a23a6c17b726734ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:43.019395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-55766d1d-eefe-4706-a106-033a050fdf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:43.020031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a1ad39aa6747cb957cf596cc2a13f4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:43.020730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a1ad39aa6747cb957cf596cc2a13f4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:43.031049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a1ad39aa6747cb957cf596cc2a13f4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:43.053258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a1ad39aa6747cb957cf596cc2a13f4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:43.054103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-75cc6db2-c40e-4482-ae7d-4fc282170fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a1ad39aa6747cb957cf596cc2a13f4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:43.074918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 979/1988] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:42 2022] DELETE /identity/v3/users/e0a1ad39aa6747cb957cf596cc2a13f4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:43.076668 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3906e00-bcec-4ac6-990f-d55744ba1624 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:43.076965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3906e00-bcec-4ac6-990f-d55744ba1624 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:43.078974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3906e00-bcec-4ac6-990f-d55744ba1624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:43.099834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:43.110492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a3906e00-bcec-4ac6-990f-d55744ba1624 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:43.112729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a3906e00-bcec-4ac6-990f-d55744ba1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:43.149597 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1010/1989] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:43.169906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:43.208002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 980/1990] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:43.252188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55766d1d-eefe-4706-a106-033a050fdf65 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:43.253850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-55766d1d-eefe-4706-a106-033a050fdf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:43.275173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55766d1d-eefe-4706-a106-033a050fdf65 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:43.358941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad2fb-fbe3-4d60-8a66-c138bf64f294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:43.360174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad2fb-fbe3-4d60-8a66-c138bf64f294 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:43.360638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad2fb-fbe3-4d60-8a66-c138bf64f294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:43.361934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad2fb-fbe3-4d60-8a66-c138bf64f294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:43.374758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ad2fb-fbe3-4d60-8a66-c138bf64f294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:43.376838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ad2fb-fbe3-4d60-8a66-c138bf64f294 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:43.389860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1011/1991] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:43.740947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3906e00-bcec-4ac6-990f-d55744ba1624 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:43.742923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a3906e00-bcec-4ac6-990f-d55744ba1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:43.755768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3906e00-bcec-4ac6-990f-d55744ba1624 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:43.764502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:43.766103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:43.767221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:43.767743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] PATH_INFO: `/v3/projects/7321310f3d1446ad90071920f71742be` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:43.769130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7321310f3d1446ad90071920f71742be)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:43.771473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:43.832511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7321310f3d1446ad90071920f71742be', 'request_id': 'req-a04d8552-dbb8-4160-8c54-fed735e6f8fd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:43.839135 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7321310f3d1446ad90071920f71742be', 'request_id': 'req-a04d8552-dbb8-4160-8c54-fed735e6f8fd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:43.846691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7321310f3d1446ad90071920f71742be', 'request_id': 'req-a04d8552-dbb8-4160-8c54-fed735e6f8fd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:43.874912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] The token cache is being invalidate because project 7321310f3d1446ad90071920f71742be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:43.875355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:43.876337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:43.878529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 981/1992] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:43 2022] DELETE /identity/v3/projects/7321310f3d1446ad90071920f71742be => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:43.884712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad2fb-fbe3-4d60-8a66-c138bf64f294 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:43.897290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad2fb-fbe3-4d60-8a66-c138bf64f294 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:43.967694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:43.968589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:43.969032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:43.969462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] PATH_INFO: `/v3/users/a46d91b2bb554f75831eb3142e44287b` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:43.971348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46d91b2bb554f75831eb3142e44287b)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:43.973306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:44.051556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:44.058065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:44.061041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46d91b2bb554f75831eb3142e44287b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.071402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46d91b2bb554f75831eb3142e44287b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.084991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46d91b2bb554f75831eb3142e44287b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.097796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d8552-dbb8-4160-8c54-fed735e6f8fd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:44.104538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46d91b2bb554f75831eb3142e44287b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.105107 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:44.105774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46d91b2bb554f75831eb3142e44287b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.105895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:44.106235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:44.106619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] PATH_INFO: `/v3/projects/817f06bf82b24c4f8fa24fef27ee5910` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:44.108011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=817f06bf82b24c4f8fa24fef27ee5910)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:44.111920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:44.123148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1012/1993] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:43 2022] DELETE /identity/v3/users/a46d91b2bb554f75831eb3142e44287b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:44.188211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817f06bf82b24c4f8fa24fef27ee5910', 'request_id': 'req-cf1adc54-07ea-4564-befc-4191bc67cbbd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.197685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817f06bf82b24c4f8fa24fef27ee5910', 'request_id': 'req-cf1adc54-07ea-4564-befc-4191bc67cbbd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.206827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817f06bf82b24c4f8fa24fef27ee5910', 'request_id': 'req-cf1adc54-07ea-4564-befc-4191bc67cbbd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.234598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] The token cache is being invalidate because project 817f06bf82b24c4f8fa24fef27ee5910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:44.235228 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.236113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.239292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 982/1994] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:44 2022] DELETE /identity/v3/projects/817f06bf82b24c4f8fa24fef27ee5910 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:44.243374 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:44.245253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:44.257758 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:44.356921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c59e4a-0595-4ede-9bac-e6cce6154d86 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:44.442123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:44.443027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:44.443881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:44.443881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] PATH_INFO: `/v3/users/7875dcc13ed84d568121da68e08a9f28` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:44.445920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7875dcc13ed84d568121da68e08a9f28)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:44.448247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:44.573774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:44.575265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:44.584382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7875dcc13ed84d568121da68e08a9f28'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.585408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7875dcc13ed84d568121da68e08a9f28'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.599858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7875dcc13ed84d568121da68e08a9f28'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.612846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1adc54-07ea-4564-befc-4191bc67cbbd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:44.626196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7875dcc13ed84d568121da68e08a9f28'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.628013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-25ebde9a-b3be-4266-b1b1-5920ea26c4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7875dcc13ed84d568121da68e08a9f28'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.642650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:44.643223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:44.643501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:44.643782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] PATH_INFO: `/v3/projects/b4b52866317248f0a36c3e61fcc513cf` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:44.645455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b52866317248f0a36c3e61fcc513cf)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:44.647729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:44.651653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1013/1995] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:44 2022] DELETE /identity/v3/users/7875dcc13ed84d568121da68e08a9f28 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:44.724173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:44.728921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b52866317248f0a36c3e61fcc513cf', 'request_id': 'req-d6068ede-3f0d-4251-8854-140742594551'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.748948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b52866317248f0a36c3e61fcc513cf', 'request_id': 'req-d6068ede-3f0d-4251-8854-140742594551'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.762917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b52866317248f0a36c3e61fcc513cf', 'request_id': 'req-d6068ede-3f0d-4251-8854-140742594551'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.783434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] The token cache is being invalidate because project b4b52866317248f0a36c3e61fcc513cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:44.784153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.784883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6068ede-3f0d-4251-8854-140742594551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:44.787116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 983/1996] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:44 2022] DELETE /identity/v3/projects/b4b52866317248f0a36c3e61fcc513cf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:44.792456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6b2aa-19c8-46ef-9dcb-b77177423b32 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:44.792736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6b2aa-19c8-46ef-9dcb-b77177423b32 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:44.793020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6b2aa-19c8-46ef-9dcb-b77177423b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:44.817483 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ecf6b2aa-19c8-46ef-9dcb-b77177423b32 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:44.819282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ecf6b2aa-19c8-46ef-9dcb-b77177423b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:44.879233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:44.914099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1014/1997] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:44.922058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d423c-7d6f-4f65-b34b-df849cef0697 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:44.922608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d423c-7d6f-4f65-b34b-df849cef0697 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:44.922891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d423c-7d6f-4f65-b34b-df849cef0697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:44.943342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6b6d423c-7d6f-4f65-b34b-df849cef0697 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:44.944671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6b6d423c-7d6f-4f65-b34b-df849cef0697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:44.953204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 984/1998] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:44.957296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6b2aa-19c8-46ef-9dcb-b77177423b32 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:44.968231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6b2aa-19c8-46ef-9dcb-b77177423b32 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:44.973279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700fc66-a8eb-4200-8641-2f960352fba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:44.973930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700fc66-a8eb-4200-8641-2f960352fba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:44.974213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700fc66-a8eb-4200-8641-2f960352fba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:44.974563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700fc66-a8eb-4200-8641-2f960352fba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:44.976104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700fc66-a8eb-4200-8641-2f960352fba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:44.976503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700fc66-a8eb-4200-8641-2f960352fba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:44.978137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700fc66-a8eb-4200-8641-2f960352fba3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:44.992244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1015/1999] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:44.997772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700fc66-a8eb-4200-8641-2f960352fba3 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:44.997921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d423c-7d6f-4f65-b34b-df849cef0697 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:44.999230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6b6d423c-7d6f-4f65-b34b-df849cef0697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:45.007736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700fc66-a8eb-4200-8641-2f960352fba3 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.012385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69036d82-db06-4c34-bbf4-245b60b119f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.013050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69036d82-db06-4c34-bbf4-245b60b119f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.013267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69036d82-db06-4c34-bbf4-245b60b119f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.013549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69036d82-db06-4c34-bbf4-245b60b119f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.014207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69036d82-db06-4c34-bbf4-245b60b119f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.016131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d423c-7d6f-4f65-b34b-df849cef0697 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.017321 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69036d82-db06-4c34-bbf4-245b60b119f4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.021151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.021924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.022215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.022553 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] PATH_INFO: `/v3/projects/6465b7727e7c4ed8bcdfc4605f61ad60` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.023747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6465b7727e7c4ed8bcdfc4605f61ad60)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.026009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.058277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1016/2000] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:44 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:45.059780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69036d82-db06-4c34-bbf4-245b60b119f4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.080817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6465b7727e7c4ed8bcdfc4605f61ad60', 'request_id': 'req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:45.087599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6465b7727e7c4ed8bcdfc4605f61ad60', 'request_id': 'req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:45.094427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6465b7727e7c4ed8bcdfc4605f61ad60', 'request_id': 'req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:45.108982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] The token cache is being invalidate because project 6465b7727e7c4ed8bcdfc4605f61ad60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:45.109274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:45.109941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7de34fe5-b5dd-47f0-80e6-7cd538e4f0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:45.112256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 985/2001] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:44 2022] DELETE /identity/v3/projects/6465b7727e7c4ed8bcdfc4605f61ad60 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:45.117934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d0166-6947-4651-8638-6154bc9d929a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.118230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d0166-6947-4651-8638-6154bc9d929a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.118560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d0166-6947-4651-8638-6154bc9d929a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.135115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69036d82-db06-4c34-bbf4-245b60b119f4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.139294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-512d0166-6947-4651-8638-6154bc9d929a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:45.140724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-512d0166-6947-4651-8638-6154bc9d929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:45.203031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaed95-6fbd-41bb-9016-39ac3422fefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.203770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaed95-6fbd-41bb-9016-39ac3422fefd admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.203945 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaed95-6fbd-41bb-9016-39ac3422fefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.204219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaed95-6fbd-41bb-9016-39ac3422fefd admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.204888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aaed95-6fbd-41bb-9016-39ac3422fefd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.206856 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aaed95-6fbd-41bb-9016-39ac3422fefd admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.217515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 986/2002] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:45.223781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b7b71-99a7-4071-bcf4-3fec5a6c245c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.224076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b7b71-99a7-4071-bcf4-3fec5a6c245c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.224402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b7b71-99a7-4071-bcf4-3fec5a6c245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.237076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1017/2003] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:45 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:09:45.240752 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaed95-6fbd-41bb-9016-39ac3422fefd admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.243137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b2aaed95-6fbd-41bb-9016-39ac3422fefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:45.258012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaed95-6fbd-41bb-9016-39ac3422fefd admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.259689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ef9b7b71-99a7-4071-bcf4-3fec5a6c245c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:45.260969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ef9b7b71-99a7-4071-bcf4-3fec5a6c245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:45.263259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89d590-557d-4284-9397-60ca8cb4baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.263923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d590-557d-4284-9397-60ca8cb4baa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.264696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d590-557d-4284-9397-60ca8cb4baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.265064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d590-557d-4284-9397-60ca8cb4baa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.265990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89d590-557d-4284-9397-60ca8cb4baa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.267729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89d590-557d-4284-9397-60ca8cb4baa4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.271850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 987/2004] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:45.275799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b7b71-99a7-4071-bcf4-3fec5a6c245c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.284252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1018/2005] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:45.285045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89d590-557d-4284-9397-60ca8cb4baa4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.287520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b7b71-99a7-4071-bcf4-3fec5a6c245c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.293369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd2a99-c2a3-4c56-b697-2874a945433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.293986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd2a99-c2a3-4c56-b697-2874a945433d admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.294386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd2a99-c2a3-4c56-b697-2874a945433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.294619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd2a99-c2a3-4c56-b697-2874a945433d admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.295274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd2a99-c2a3-4c56-b697-2874a945433d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:45.295697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd2a99-c2a3-4c56-b697-2874a945433d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.297152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd2a99-c2a3-4c56-b697-2874a945433d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.297402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89d590-557d-4284-9397-60ca8cb4baa4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.304949 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb1747-4863-4bfe-84fb-e09ef666529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.306149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1747-4863-4bfe-84fb-e09ef666529b admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.306648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1747-4863-4bfe-84fb-e09ef666529b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.307025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1747-4863-4bfe-84fb-e09ef666529b admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.307832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb1747-4863-4bfe-84fb-e09ef666529b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.309613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb1747-4863-4bfe-84fb-e09ef666529b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.314805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 988/2006] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:45.318769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd2a99-c2a3-4c56-b697-2874a945433d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.324382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1019/2007] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:45.328519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb1747-4863-4bfe-84fb-e09ef666529b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.332830 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd2a99-c2a3-4c56-b697-2874a945433d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.339351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb1747-4863-4bfe-84fb-e09ef666529b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.340643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a295b-35d5-4716-b0b7-81df344b5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.341257 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a295b-35d5-4716-b0b7-81df344b5da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.341542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a295b-35d5-4716-b0b7-81df344b5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.341813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a295b-35d5-4716-b0b7-81df344b5da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.342585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a295b-35d5-4716-b0b7-81df344b5da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.344562 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a295b-35d5-4716-b0b7-81df344b5da7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.345576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e9ce8-a8ea-4209-a145-e6e693d04b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.346411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9ce8-a8ea-4209-a145-e6e693d04b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.346734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9ce8-a8ea-4209-a145-e6e693d04b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.347018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9ce8-a8ea-4209-a145-e6e693d04b5f admin admin] PATH_INFO: `/v3/projects/e92f6c51727d458fa80d624e42d3898e/users/517810f2e52344e88d521d3cc9d05e67/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.361880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:45.367975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e9ce8-a8ea-4209-a145-e6e693d04b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92f6c51727d458fa80d624e42d3898e, user_id=517810f2e52344e88d521d3cc9d05e67, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.371602 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e9ce8-a8ea-4209-a145-e6e693d04b5f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.392018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 989/2008] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:45 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:45.393600 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1020/2009] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:45 2022] PUT /identity/v3/projects/e92f6c51727d458fa80d624e42d3898e/users/517810f2e52344e88d521d3cc9d05e67/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:45.394513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a295b-35d5-4716-b0b7-81df344b5da7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.404763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac8130-9874-4e40-8502-38a1b29ebadd None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.404763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac8130-9874-4e40-8502-38a1b29ebadd None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.404983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac8130-9874-4e40-8502-38a1b29ebadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.410193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:45.460455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-02ac8130-9874-4e40-8502-38a1b29ebadd None None] MFA Rules not processed for user `517810f2e52344e88d521d3cc9d05e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:45.461797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-02ac8130-9874-4e40-8502-38a1b29ebadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:45.488090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a295b-35d5-4716-b0b7-81df344b5da7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.497505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29913ce-f29a-42bc-8820-e0057ef578bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.498206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29913ce-f29a-42bc-8820-e0057ef578bd admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.498585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29913ce-f29a-42bc-8820-e0057ef578bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.498908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29913ce-f29a-42bc-8820-e0057ef578bd admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.499831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29913ce-f29a-42bc-8820-e0057ef578bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.502143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29913ce-f29a-42bc-8820-e0057ef578bd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.534975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 990/2010] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:45 2022] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:45.555496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29913ce-f29a-42bc-8820-e0057ef578bd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.590542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29913ce-f29a-42bc-8820-e0057ef578bd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.593188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1021/2011] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:45.597756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac8130-9874-4e40-8502-38a1b29ebadd None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.611639 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269e30-2382-4668-b1da-40b508a41d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.612342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269e30-2382-4668-b1da-40b508a41d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.612628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269e30-2382-4668-b1da-40b508a41d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.612908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269e30-2382-4668-b1da-40b508a41d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.613666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f269e30-2382-4668-b1da-40b508a41d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.615576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f269e30-2382-4668-b1da-40b508a41d7f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.620140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac8130-9874-4e40-8502-38a1b29ebadd None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.634067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 991/2012] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:45.635027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269e30-2382-4668-b1da-40b508a41d7f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.650790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269e30-2382-4668-b1da-40b508a41d7f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.660719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef011-5467-4f8a-ab52-0f6b22c4864b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.661791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef011-5467-4f8a-ab52-0f6b22c4864b admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.663774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef011-5467-4f8a-ab52-0f6b22c4864b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.664225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef011-5467-4f8a-ab52-0f6b22c4864b admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.664350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded229a-cf8e-4b9d-a72a-fc22d30df8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.665967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ef011-5467-4f8a-ab52-0f6b22c4864b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.666086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded229a-cf8e-4b9d-a72a-fc22d30df8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.666525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded229a-cf8e-4b9d-a72a-fc22d30df8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.668245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded229a-cf8e-4b9d-a72a-fc22d30df8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.669035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded229a-cf8e-4b9d-a72a-fc22d30df8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.672412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ef011-5467-4f8a-ab52-0f6b22c4864b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.673833 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded229a-cf8e-4b9d-a72a-fc22d30df8a9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.707020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 992/2013] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:45.708388 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded229a-cf8e-4b9d-a72a-fc22d30df8a9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.726037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded229a-cf8e-4b9d-a72a-fc22d30df8a9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.737797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85d05c-8596-4862-a11a-fe8a50a1bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.739320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d05c-8596-4862-a11a-fe8a50a1bcee admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.739599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d05c-8596-4862-a11a-fe8a50a1bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.739871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d05c-8596-4862-a11a-fe8a50a1bcee admin admin] PATH_INFO: `/v3/projects/8c661cd5e50c47a4aed3655f5233ac6b/users/87fc1c400ceb4424848bc3f57625f85d/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.750776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1022/2014] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:45 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:09:45.754267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef011-5467-4f8a-ab52-0f6b22c4864b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.779650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85d05c-8596-4862-a11a-fe8a50a1bcee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c661cd5e50c47a4aed3655f5233ac6b, user_id=87fc1c400ceb4424848bc3f57625f85d, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.785993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85d05c-8596-4862-a11a-fe8a50a1bcee admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.814695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 993/2015] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:45 2022] PUT /identity/v3/projects/8c661cd5e50c47a4aed3655f5233ac6b/users/87fc1c400ceb4424848bc3f57625f85d/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:45.822639 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ab65-1f31-4ac6-9407-4103452de90e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.823127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ab65-1f31-4ac6-9407-4103452de90e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.823748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ab65-1f31-4ac6-9407-4103452de90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.851100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef011-5467-4f8a-ab52-0f6b22c4864b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:45.856303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d011ab65-1f31-4ac6-9407-4103452de90e None None] MFA Rules not processed for user `87fc1c400ceb4424848bc3f57625f85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:45.864121 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d011ab65-1f31-4ac6-9407-4103452de90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:45.933793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fe9ca-055d-4418-9e84-d2df16721d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:45.934405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fe9ca-055d-4418-9e84-d2df16721d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:45.934734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fe9ca-055d-4418-9e84-d2df16721d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:45.935108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fe9ca-055d-4418-9e84-d2df16721d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:45.935803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fe9ca-055d-4418-9e84-d2df16721d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:45.937764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fe9ca-055d-4418-9e84-d2df16721d88 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:45.948793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:45.964056 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 994/2016] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:45.977170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1023/2017] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:45 2022] POST /identity/v3/users => generated 303 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:45.983681 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ab65-1f31-4ac6-9407-4103452de90e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.984862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fe9ca-055d-4418-9e84-d2df16721d88 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:45.987030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-362fe9ca-055d-4418-9e84-d2df16721d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:45.996993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ab65-1f31-4ac6-9407-4103452de90e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:46.003324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552cea6-4ca0-4529-bc61-e1d570f44dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:46.004207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552cea6-4ca0-4529-bc61-e1d570f44dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:46.004726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552cea6-4ca0-4529-bc61-e1d570f44dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:46.005194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552cea6-4ca0-4529-bc61-e1d570f44dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:46.006246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552cea6-4ca0-4529-bc61-e1d570f44dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:46.008995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552cea6-4ca0-4529-bc61-e1d570f44dc9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:46.025109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 995/2018] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:46.026155 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552cea6-4ca0-4529-bc61-e1d570f44dc9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:46.036913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552cea6-4ca0-4529-bc61-e1d570f44dc9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:46.042478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daecfbf-ad08-4090-b249-7cc2a112641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:46.043026 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daecfbf-ad08-4090-b249-7cc2a112641a admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:46.043300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daecfbf-ad08-4090-b249-7cc2a112641a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:46.043570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daecfbf-ad08-4090-b249-7cc2a112641a admin admin] PATH_INFO: `/v3/projects/9682b31170c94a62a2963f8b47f0627b/users/fa6c409c5ccf41e0a39a87adeef4407f/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:46.060065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daecfbf-ad08-4090-b249-7cc2a112641a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9682b31170c94a62a2963f8b47f0627b, user_id=fa6c409c5ccf41e0a39a87adeef4407f, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:46.062778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daecfbf-ad08-4090-b249-7cc2a112641a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:46.081247 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 996/2019] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:46 2022] PUT /identity/v3/projects/9682b31170c94a62a2963f8b47f0627b/users/fa6c409c5ccf41e0a39a87adeef4407f/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:46.086151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daecfbf-ad08-4090-b249-7cc2a112641a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:46.089578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fe9ca-055d-4418-9e84-d2df16721d88 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:46.097584 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:46.150496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd05a2-cb1f-4dc3-a1f1-d40c14a79c9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece4e0b16a9441b5ba14bbc8ff1c632c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:46.151318 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd05a2-cb1f-4dc3-a1f1-d40c14a79c9d service glance] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:46.151664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd05a2-cb1f-4dc3-a1f1-d40c14a79c9d service glance] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:46.152144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd05a2-cb1f-4dc3-a1f1-d40c14a79c9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:46.165867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daecfbf-ad08-4090-b249-7cc2a112641a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:46.170682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d470-d57c-4d9d-9370-259ebaca885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:46.171306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d470-d57c-4d9d-9370-259ebaca885a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:46.171593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d470-d57c-4d9d-9370-259ebaca885a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:46.171884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d470-d57c-4d9d-9370-259ebaca885a admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:46.172567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2d470-d57c-4d9d-9370-259ebaca885a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:46.174208 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2d470-d57c-4d9d-9370-259ebaca885a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:46.184135 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 997/2020] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:46.188361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d470-d57c-4d9d-9370-259ebaca885a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:46.199460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d470-d57c-4d9d-9370-259ebaca885a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:46.204345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cb53a-2b1a-43b9-9c26-7e7718d8a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:46.204791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cb53a-2b1a-43b9-9c26-7e7718d8a5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:46.205076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cb53a-2b1a-43b9-9c26-7e7718d8a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:46.205352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cb53a-2b1a-43b9-9c26-7e7718d8a5a3 admin admin] PATH_INFO: `/v3/projects/9682b31170c94a62a2963f8b47f0627b/users/fa6c409c5ccf41e0a39a87adeef4407f/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:46.207348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cb53a-2b1a-43b9-9c26-7e7718d8a5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9682b31170c94a62a2963f8b47f0627b, user_id=fa6c409c5ccf41e0a39a87adeef4407f, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:46.210609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cb53a-2b1a-43b9-9c26-7e7718d8a5a3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:46.213991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd05a2-cb1f-4dc3-a1f1-d40c14a79c9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:46.215637 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd05a2-cb1f-4dc3-a1f1-d40c14a79c9d service glance] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:46.220889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 998/2021] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:46 2022] PUT /identity/v3/projects/9682b31170c94a62a2963f8b47f0627b/users/fa6c409c5ccf41e0a39a87adeef4407f/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:46.224738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1024/2022] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:46.231020 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93645234-f624-4a05-b222-e63df3c05f01 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:46.231321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93645234-f624-4a05-b222-e63df3c05f01 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:46.231576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93645234-f624-4a05-b222-e63df3c05f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:46.271441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-93645234-f624-4a05-b222-e63df3c05f01 None None] MFA Rules not processed for user `fa6c409c5ccf41e0a39a87adeef4407f`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:46.273777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-93645234-f624-4a05-b222-e63df3c05f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:46.433747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 999/2023] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:46.447517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd05a2-cb1f-4dc3-a1f1-d40c14a79c9d service glance] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:46.449203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2fcd05a2-cb1f-4dc3-a1f1-d40c14a79c9d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:46.524348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:46.537094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd05a2-cb1f-4dc3-a1f1-d40c14a79c9d service glance] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:46.589158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60717374-a846-4547-8b9f-34b4a87ce040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:46.589880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60717374-a846-4547-8b9f-34b4a87ce040 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:46.590228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60717374-a846-4547-8b9f-34b4a87ce040 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:46.590594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60717374-a846-4547-8b9f-34b4a87ce040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:46.601217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60717374-a846-4547-8b9f-34b4a87ce040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:46.602779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60717374-a846-4547-8b9f-34b4a87ce040 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:46.612606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1025/2024] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:46.659019 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93645234-f624-4a05-b222-e63df3c05f01 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:46.669787 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93645234-f624-4a05-b222-e63df3c05f01 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:46.674588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bda3d-ef8c-4b77-b532-76b12a3f70cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:46.675240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bda3d-ef8c-4b77-b532-76b12a3f70cd service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:46.675532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bda3d-ef8c-4b77-b532-76b12a3f70cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:46.675794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bda3d-ef8c-4b77-b532-76b12a3f70cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:46.740002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bda3d-ef8c-4b77-b532-76b12a3f70cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:46.742227 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bda3d-ef8c-4b77-b532-76b12a3f70cd service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:46.752356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1000/2025] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:50.300534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60717374-a846-4547-8b9f-34b4a87ce040 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:50.364694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60717374-a846-4547-8b9f-34b4a87ce040 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:50.374919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:50.375573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:50.375854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:50.376127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] PATH_INFO: `/v3/users/517810f2e52344e88d521d3cc9d05e67` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:50.377312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=517810f2e52344e88d521d3cc9d05e67)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:50.379341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:50.438930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517810f2e52344e88d521d3cc9d05e67'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:50.439847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517810f2e52344e88d521d3cc9d05e67'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:50.447127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517810f2e52344e88d521d3cc9d05e67'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:50.460842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517810f2e52344e88d521d3cc9d05e67'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:50.461627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517810f2e52344e88d521d3cc9d05e67'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:50.474498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1026/2026] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:50 2022] DELETE /identity/v3/users/517810f2e52344e88d521d3cc9d05e67 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:50.479633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc896-ba99-402f-ab06-198c9f26a489 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:50.480142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc896-ba99-402f-ab06-198c9f26a489 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:50.480299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc896-ba99-402f-ab06-198c9f26a489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:50.500290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d65fc896-ba99-402f-ab06-198c9f26a489 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:50.501493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d65fc896-ba99-402f-ab06-198c9f26a489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:50.514210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:50.582472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1001/2027] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:50.591199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:50.593014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:50.627527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:50.712262 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f178a-6c36-4400-80c3-de04dce9fa6f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:50.720572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ef3b-9811-49ab-acfa-81cb0356cd89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:50.721387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ef3b-9811-49ab-acfa-81cb0356cd89 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:50.722380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ef3b-9811-49ab-acfa-81cb0356cd89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:50.722821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ef3b-9811-49ab-acfa-81cb0356cd89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:50.745913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172ef3b-9811-49ab-acfa-81cb0356cd89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:50.748693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172ef3b-9811-49ab-acfa-81cb0356cd89 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:50.767641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1027/2028] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:51.149192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fc896-ba99-402f-ab06-198c9f26a489 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:51.150756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d65fc896-ba99-402f-ab06-198c9f26a489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:51.172188 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fc896-ba99-402f-ab06-198c9f26a489 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:51.188115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:51.188885 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:51.189963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:51.190382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] PATH_INFO: `/v3/projects/e92f6c51727d458fa80d624e42d3898e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:51.191866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92f6c51727d458fa80d624e42d3898e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:51.194626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:51.247091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92f6c51727d458fa80d624e42d3898e', 'request_id': 'req-92f6ed6a-2727-415a-bcf4-e226732d62e8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:51.253700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92f6c51727d458fa80d624e42d3898e', 'request_id': 'req-92f6ed6a-2727-415a-bcf4-e226732d62e8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:51.263501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92f6c51727d458fa80d624e42d3898e', 'request_id': 'req-92f6ed6a-2727-415a-bcf4-e226732d62e8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:51.277943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] The token cache is being invalidate because project e92f6c51727d458fa80d624e42d3898e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:51.278226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:51.278884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:51.280412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1002/2029] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:51 2022] DELETE /identity/v3/projects/e92f6c51727d458fa80d624e42d3898e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:51.284632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ef3b-9811-49ab-acfa-81cb0356cd89 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:51.294277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ef3b-9811-49ab-acfa-81cb0356cd89 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:51.359250 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:51.359955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:51.360165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:51.360435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] PATH_INFO: `/v3/users/fa6c409c5ccf41e0a39a87adeef4407f` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:51.361627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6c409c5ccf41e0a39a87adeef4407f)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:51.364305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:51.415566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6c409c5ccf41e0a39a87adeef4407f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:51.416238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6c409c5ccf41e0a39a87adeef4407f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:51.424527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6c409c5ccf41e0a39a87adeef4407f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:51.438769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6c409c5ccf41e0a39a87adeef4407f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:51.440287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-eb368797-5cfc-49ea-b1a0-9672dc753d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6c409c5ccf41e0a39a87adeef4407f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:51.459287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1028/2030] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:51 2022] DELETE /identity/v3/users/fa6c409c5ccf41e0a39a87adeef4407f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:51.813857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:51.817481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:51.839743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6ed6a-2727-415a-bcf4-e226732d62e8 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:51.936969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:51.938659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:51.938951 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:51.939295 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] PATH_INFO: `/v3/projects/9682b31170c94a62a2963f8b47f0627b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:51.943135 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9682b31170c94a62a2963f8b47f0627b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:51.948365 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:52.013071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:52.029371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9682b31170c94a62a2963f8b47f0627b', 'request_id': 'req-c15ff2de-2e20-429d-9588-e13a7ea7afb2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:52.036130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9682b31170c94a62a2963f8b47f0627b', 'request_id': 'req-c15ff2de-2e20-429d-9588-e13a7ea7afb2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:52.044062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9682b31170c94a62a2963f8b47f0627b', 'request_id': 'req-c15ff2de-2e20-429d-9588-e13a7ea7afb2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:52.081691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] The token cache is being invalidate because project 9682b31170c94a62a2963f8b47f0627b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:52.081983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:52.087572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c15ff2de-2e20-429d-9588-e13a7ea7afb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:52.099299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1003/2031] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:51 2022] DELETE /identity/v3/projects/9682b31170c94a62a2963f8b47f0627b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:52.100903 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533939f0-050d-4b0e-ab09-66e01524da72 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:52.101192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533939f0-050d-4b0e-ab09-66e01524da72 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:52.101567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533939f0-050d-4b0e-ab09-66e01524da72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:52.134187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-533939f0-050d-4b0e-ab09-66e01524da72 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:52.135662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-533939f0-050d-4b0e-ab09-66e01524da72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:52.228096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:52.279081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1029/2032] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:52.288573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08005c4-6b54-40cf-b22c-6ab2c47a55b1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:52.288882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08005c4-6b54-40cf-b22c-6ab2c47a55b1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:52.289232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08005c4-6b54-40cf-b22c-6ab2c47a55b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:52.314686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a08005c4-6b54-40cf-b22c-6ab2c47a55b1 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:52.315933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a08005c4-6b54-40cf-b22c-6ab2c47a55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:52.324134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1004/2033] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:52.328395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533939f0-050d-4b0e-ab09-66e01524da72 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:52.338016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533939f0-050d-4b0e-ab09-66e01524da72 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:52.342771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15412f-e97c-4acf-bd5a-c21f07310e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:52.343381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15412f-e97c-4acf-bd5a-c21f07310e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:52.343661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15412f-e97c-4acf-bd5a-c21f07310e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:52.343937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15412f-e97c-4acf-bd5a-c21f07310e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:52.344641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15412f-e97c-4acf-bd5a-c21f07310e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:52.344968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15412f-e97c-4acf-bd5a-c21f07310e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:52.346956 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15412f-e97c-4acf-bd5a-c21f07310e79 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:52.363244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1030/2034] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:52.364284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08005c4-6b54-40cf-b22c-6ab2c47a55b1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:52.386202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08005c4-6b54-40cf-b22c-6ab2c47a55b1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:52.391517 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b518-dd3f-42b6-8ed1-acc2688a302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:52.392256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b518-dd3f-42b6-8ed1-acc2688a302b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:52.392403 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b518-dd3f-42b6-8ed1-acc2688a302b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:52.393041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b518-dd3f-42b6-8ed1-acc2688a302b admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:52.393348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097b518-dd3f-42b6-8ed1-acc2688a302b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:52.395647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097b518-dd3f-42b6-8ed1-acc2688a302b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:52.445027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1005/2035] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:52 2022] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:52.447140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15412f-e97c-4acf-bd5a-c21f07310e79 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:52.460324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15412f-e97c-4acf-bd5a-c21f07310e79 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:52.548504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921b398-8865-43bc-8262-dea001685f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:52.549286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921b398-8865-43bc-8262-dea001685f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:52.549669 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921b398-8865-43bc-8262-dea001685f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:52.550045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921b398-8865-43bc-8262-dea001685f95 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:52.550876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921b398-8865-43bc-8262-dea001685f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:52.552908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921b398-8865-43bc-8262-dea001685f95 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:52.576895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1031/2036] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:52 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:52.580789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b518-dd3f-42b6-8ed1-acc2688a302b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:52.597228 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b518-dd3f-42b6-8ed1-acc2688a302b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:52.608111 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbf707-1b11-43e1-b84e-fecdc0dcad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:52.608742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbf707-1b11-43e1-b84e-fecdc0dcad50 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:52.609156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbf707-1b11-43e1-b84e-fecdc0dcad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:52.609481 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbf707-1b11-43e1-b84e-fecdc0dcad50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:52.610186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbf707-1b11-43e1-b84e-fecdc0dcad50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:52.611887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbf707-1b11-43e1-b84e-fecdc0dcad50 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:52.626473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1006/2037] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:52.629268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921b398-8865-43bc-8262-dea001685f95 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:52.639992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921b398-8865-43bc-8262-dea001685f95 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:52.644738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa1552-11e2-4831-af6a-9e8cf19c8a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:52.645353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa1552-11e2-4831-af6a-9e8cf19c8a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:52.645711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa1552-11e2-4831-af6a-9e8cf19c8a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:52.645934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa1552-11e2-4831-af6a-9e8cf19c8a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:52.646687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa1552-11e2-4831-af6a-9e8cf19c8a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:52.648881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa1552-11e2-4831-af6a-9e8cf19c8a04 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:52.660337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1032/2038] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:52.665083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbf707-1b11-43e1-b84e-fecdc0dcad50 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:52.679323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbf707-1b11-43e1-b84e-fecdc0dcad50 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:52.686727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce979c-92f7-4020-b1f9-3e295ebce4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:52.688034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce979c-92f7-4020-b1f9-3e295ebce4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:52.688034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce979c-92f7-4020-b1f9-3e295ebce4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:52.688570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce979c-92f7-4020-b1f9-3e295ebce4d4 admin admin] PATH_INFO: `/v3/projects/6ce9bdd665064e2f84cd7701e5f6ae7e/users/3c13808aaaaf489bbe05966ef40d7218/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:52.705412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce979c-92f7-4020-b1f9-3e295ebce4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce9bdd665064e2f84cd7701e5f6ae7e, user_id=3c13808aaaaf489bbe05966ef40d7218, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:52.708985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce979c-92f7-4020-b1f9-3e295ebce4d4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:52.723596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1007/2039] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:52 2022] PUT /identity/v3/projects/6ce9bdd665064e2f84cd7701e5f6ae7e/users/3c13808aaaaf489bbe05966ef40d7218/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:52.734616 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c37f-91ea-4c67-8c9d-f0d8510e7a1c None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:52.734967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c37f-91ea-4c67-8c9d-f0d8510e7a1c None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:52.735305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c37f-91ea-4c67-8c9d-f0d8510e7a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:52.764416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-20a7c37f-91ea-4c67-8c9d-f0d8510e7a1c None None] MFA Rules not processed for user `3c13808aaaaf489bbe05966ef40d7218`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:52.765765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-20a7c37f-91ea-4c67-8c9d-f0d8510e7a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:52.849034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1033/2040] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:52.854310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce979c-92f7-4020-b1f9-3e295ebce4d4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:52.941272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce979c-92f7-4020-b1f9-3e295ebce4d4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:52.946626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301aba-5470-45f2-aafa-034cc2b2fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:52.947288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301aba-5470-45f2-aafa-034cc2b2fe5e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:52.947564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301aba-5470-45f2-aafa-034cc2b2fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:52.947837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301aba-5470-45f2-aafa-034cc2b2fe5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:52.948507 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb301aba-5470-45f2-aafa-034cc2b2fe5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:52.950426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb301aba-5470-45f2-aafa-034cc2b2fe5e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:52.985336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1008/2041] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:52 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:52.991775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7c37f-91ea-4c67-8c9d-f0d8510e7a1c None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:53.002712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7c37f-91ea-4c67-8c9d-f0d8510e7a1c None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:53.055333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:53.099088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6176a-9683-40f1-856b-6191aa655375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:53.099838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6176a-9683-40f1-856b-6191aa655375 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:53.100242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6176a-9683-40f1-856b-6191aa655375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:53.100660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6176a-9683-40f1-856b-6191aa655375 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:53.101434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6176a-9683-40f1-856b-6191aa655375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:53.103887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6176a-9683-40f1-856b-6191aa655375 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:53.137193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1034/2042] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:52 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:53.141173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301aba-5470-45f2-aafa-034cc2b2fe5e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:53.156416 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301aba-5470-45f2-aafa-034cc2b2fe5e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:53.162826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f12a9-4179-41c5-ba36-ef80ed5af613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:53.163694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f12a9-4179-41c5-ba36-ef80ed5af613 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:53.164089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f12a9-4179-41c5-ba36-ef80ed5af613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:53.164467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f12a9-4179-41c5-ba36-ef80ed5af613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:53.165247 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f12a9-4179-41c5-ba36-ef80ed5af613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:53.167022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f12a9-4179-41c5-ba36-ef80ed5af613 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:53.179720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1009/2043] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:53.183735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6176a-9683-40f1-856b-6191aa655375 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:53.195377 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6176a-9683-40f1-856b-6191aa655375 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:53.205651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10363d-6510-49cb-9849-f93a50290802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:53.206349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10363d-6510-49cb-9849-f93a50290802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:53.206671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10363d-6510-49cb-9849-f93a50290802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:53.206951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10363d-6510-49cb-9849-f93a50290802 admin admin] PATH_INFO: `/v3/projects/02b5afc1981d4ee69ceaba624bac7b47/users/eb446ff6477a4873af83f3dbe9b678f4/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:53.224435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10363d-6510-49cb-9849-f93a50290802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b5afc1981d4ee69ceaba624bac7b47, user_id=eb446ff6477a4873af83f3dbe9b678f4, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:53.227306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10363d-6510-49cb-9849-f93a50290802 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:53.244754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1035/2044] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:53 2022] PUT /identity/v3/projects/02b5afc1981d4ee69ceaba624bac7b47/users/eb446ff6477a4873af83f3dbe9b678f4/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:53.248892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f12a9-4179-41c5-ba36-ef80ed5af613 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:53.265086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f12a9-4179-41c5-ba36-ef80ed5af613 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:53.332757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:53.371311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279074c-c04b-4adf-a5c0-2bf83f82512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:53.372193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279074c-c04b-4adf-a5c0-2bf83f82512c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:53.372474 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279074c-c04b-4adf-a5c0-2bf83f82512c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:53.372749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279074c-c04b-4adf-a5c0-2bf83f82512c admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:53.373466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279074c-c04b-4adf-a5c0-2bf83f82512c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:53.375112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279074c-c04b-4adf-a5c0-2bf83f82512c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:53.386624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1010/2045] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:53.390945 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10363d-6510-49cb-9849-f93a50290802 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:53.402082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10363d-6510-49cb-9849-f93a50290802 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:53.408360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ace2d-0d85-44a5-a3e1-da601e47ade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:53.411234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ace2d-0d85-44a5-a3e1-da601e47ade3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:53.411904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ace2d-0d85-44a5-a3e1-da601e47ade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:53.412254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ace2d-0d85-44a5-a3e1-da601e47ade3 admin admin] PATH_INFO: `/v3/projects/02b5afc1981d4ee69ceaba624bac7b47/users/eb446ff6477a4873af83f3dbe9b678f4/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:53.418408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ace2d-0d85-44a5-a3e1-da601e47ade3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b5afc1981d4ee69ceaba624bac7b47, user_id=eb446ff6477a4873af83f3dbe9b678f4, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:53.421767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ace2d-0d85-44a5-a3e1-da601e47ade3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:53.438132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279074c-c04b-4adf-a5c0-2bf83f82512c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:53.440657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5279074c-c04b-4adf-a5c0-2bf83f82512c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:53.442754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1036/2046] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:53 2022] PUT /identity/v3/projects/02b5afc1981d4ee69ceaba624bac7b47/users/eb446ff6477a4873af83f3dbe9b678f4/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:53.454304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014854-b605-4fc4-bc0a-9d6dacae47a9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:53.454653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014854-b605-4fc4-bc0a-9d6dacae47a9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:53.454909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014854-b605-4fc4-bc0a-9d6dacae47a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:53.456515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279074c-c04b-4adf-a5c0-2bf83f82512c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:53.492551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-25014854-b605-4fc4-bc0a-9d6dacae47a9 None None] MFA Rules not processed for user `eb446ff6477a4873af83f3dbe9b678f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:53.493984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-25014854-b605-4fc4-bc0a-9d6dacae47a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:53.543233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:53.543917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:53.544191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:53.544475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] PATH_INFO: `/v3/users/27be78be366e48f197bb999559c9738b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:53.546246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27be78be366e48f197bb999559c9738b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:53.548682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:53.586314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1037/2047] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:53.598609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014854-b605-4fc4-bc0a-9d6dacae47a9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:53.600265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-25014854-b605-4fc4-bc0a-9d6dacae47a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:53.614074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27be78be366e48f197bb999559c9738b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:53.614566 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27be78be366e48f197bb999559c9738b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:53.629109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27be78be366e48f197bb999559c9738b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:53.664864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27be78be366e48f197bb999559c9738b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:53.665721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4cad03d7-8a7c-442b-b4cb-e73d5b5159e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27be78be366e48f197bb999559c9738b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:53.703101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1011/2048] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:53 2022] DELETE /identity/v3/users/27be78be366e48f197bb999559c9738b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:53.704539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c3c0-7fc9-42ad-b6c5-501590b32a8b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:53.704829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c3c0-7fc9-42ad-b6c5-501590b32a8b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:53.705106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c3c0-7fc9-42ad-b6c5-501590b32a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:53.738682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8645c3c0-7fc9-42ad-b6c5-501590b32a8b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:53.739928 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8645c3c0-7fc9-42ad-b6c5-501590b32a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:53.742590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014854-b605-4fc4-bc0a-9d6dacae47a9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:53.798197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:53.804629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:53.832700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be4513-393f-4843-b042-af4215f4ccef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:53.833997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4513-393f-4843-b042-af4215f4ccef service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:53.834349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4513-393f-4843-b042-af4215f4ccef service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:53.834827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4513-393f-4843-b042-af4215f4ccef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:53.837851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1012/2049] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:53.849176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645c3c0-7fc9-42ad-b6c5-501590b32a8b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:53.851055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-87be4513-393f-4843-b042-af4215f4ccef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:53.851191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8645c3c0-7fc9-42ad-b6c5-501590b32a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:53.930284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645c3c0-7fc9-42ad-b6c5-501590b32a8b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:53.935522 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f9ec0-dc7a-4554-af07-532ddf2cdc67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:53.936289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f9ec0-dc7a-4554-af07-532ddf2cdc67 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:53.936568 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f9ec0-dc7a-4554-af07-532ddf2cdc67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:53.936909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f9ec0-dc7a-4554-af07-532ddf2cdc67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:53.953174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f9ec0-dc7a-4554-af07-532ddf2cdc67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:53.955397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f9ec0-dc7a-4554-af07-532ddf2cdc67 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:53.971123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be4513-393f-4843-b042-af4215f4ccef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:53.971933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1013/2050] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:53.972649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be4513-393f-4843-b042-af4215f4ccef service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:53.985527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1038/2051] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:09:54.106959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f9ec0-dc7a-4554-af07-532ddf2cdc67 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:54.108595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f14f9ec0-dc7a-4554-af07-532ddf2cdc67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:54.121631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f9ec0-dc7a-4554-af07-532ddf2cdc67 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:54.125934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151c835-dd38-46a3-b02e-58a003504c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:54.126852 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c835-dd38-46a3-b02e-58a003504c07 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:54.127170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c835-dd38-46a3-b02e-58a003504c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:54.127545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c835-dd38-46a3-b02e-58a003504c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:54.129858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7151c835-dd38-46a3-b02e-58a003504c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:54.208007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151c835-dd38-46a3-b02e-58a003504c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:54.209305 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151c835-dd38-46a3-b02e-58a003504c07 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:54.218981 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1014/2052] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:54.266084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be4513-393f-4843-b042-af4215f4ccef service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:54.267537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-87be4513-393f-4843-b042-af4215f4ccef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:54.281816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be4513-393f-4843-b042-af4215f4ccef service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:54.294046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:54.294766 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:54.295050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:54.295411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] PATH_INFO: `/v3/projects/e541915b89f846949039eab93a833cdb` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:54.297837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e541915b89f846949039eab93a833cdb)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:54.300154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:54.413751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e541915b89f846949039eab93a833cdb', 'request_id': 'req-fbbf9265-6a6f-41bc-87d7-1c97a453b288'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:54.422877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e541915b89f846949039eab93a833cdb', 'request_id': 'req-fbbf9265-6a6f-41bc-87d7-1c97a453b288'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:54.430573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e541915b89f846949039eab93a833cdb', 'request_id': 'req-fbbf9265-6a6f-41bc-87d7-1c97a453b288'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:54.443808 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] The token cache is being invalidate because project e541915b89f846949039eab93a833cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:54.444729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:54.445452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-fbbf9265-6a6f-41bc-87d7-1c97a453b288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:54.447390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1039/2053] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:54 2022] DELETE /identity/v3/projects/e541915b89f846949039eab93a833cdb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:54.453867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e2720-6e81-435b-9729-14d042e88c8e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:54.455058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e2720-6e81-435b-9729-14d042e88c8e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:54.455058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e2720-6e81-435b-9729-14d042e88c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:54.484697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-501e2720-6e81-435b-9729-14d042e88c8e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:54.486037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-501e2720-6e81-435b-9729-14d042e88c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:54.621548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1015/2054] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:54.629287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7516437-7bcf-474b-a3e1-9c56bf0d2d9a None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:54.629577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7516437-7bcf-474b-a3e1-9c56bf0d2d9a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:54.629889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7516437-7bcf-474b-a3e1-9c56bf0d2d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:54.666139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-c7516437-7bcf-474b-a3e1-9c56bf0d2d9a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:54.668200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c7516437-7bcf-474b-a3e1-9c56bf0d2d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:54.686688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1040/2055] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:54.688344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e2720-6e81-435b-9729-14d042e88c8e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:54.706528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e2720-6e81-435b-9729-14d042e88c8e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:54.715870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58e0e9-a71f-4d83-85ed-b4bb41f1a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:54.716832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58e0e9-a71f-4d83-85ed-b4bb41f1a973 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:54.717211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58e0e9-a71f-4d83-85ed-b4bb41f1a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:54.717761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58e0e9-a71f-4d83-85ed-b4bb41f1a973 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:54.719469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58e0e9-a71f-4d83-85ed-b4bb41f1a973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:54.719770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58e0e9-a71f-4d83-85ed-b4bb41f1a973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:54.721832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58e0e9-a71f-4d83-85ed-b4bb41f1a973 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:54.735334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1016/2056] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:09:54.739214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7516437-7bcf-474b-a3e1-9c56bf0d2d9a None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:54.749862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7516437-7bcf-474b-a3e1-9c56bf0d2d9a None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:54.754890 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3fd30-3518-4c27-a461-738f08f9cd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:54.756114 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3fd30-3518-4c27-a461-738f08f9cd3b admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:54.756114 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3fd30-3518-4c27-a461-738f08f9cd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:54.756114 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3fd30-3518-4c27-a461-738f08f9cd3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:54.756725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3fd30-3518-4c27-a461-738f08f9cd3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:54.758690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3fd30-3518-4c27-a461-738f08f9cd3b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:54.787311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1041/2057] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:54 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:54.793279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58e0e9-a71f-4d83-85ed-b4bb41f1a973 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:54.803093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58e0e9-a71f-4d83-85ed-b4bb41f1a973 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:54.827324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:54.893546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e31923-a911-4007-927e-c7deb6877c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:54.894182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e31923-a911-4007-927e-c7deb6877c35 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:54.894484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e31923-a911-4007-927e-c7deb6877c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:54.894762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e31923-a911-4007-927e-c7deb6877c35 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:54.895431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e31923-a911-4007-927e-c7deb6877c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:54.897893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e31923-a911-4007-927e-c7deb6877c35 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:54.922511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1017/2058] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:54 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:09:54.926657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3fd30-3518-4c27-a461-738f08f9cd3b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:54.940376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3fd30-3518-4c27-a461-738f08f9cd3b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:54.945634 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6da5d-dd73-4dcc-a99e-5662ab5e8174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:54.946537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6da5d-dd73-4dcc-a99e-5662ab5e8174 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:54.946995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6da5d-dd73-4dcc-a99e-5662ab5e8174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:54.947629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6da5d-dd73-4dcc-a99e-5662ab5e8174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:54.948675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6da5d-dd73-4dcc-a99e-5662ab5e8174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:54.950610 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6da5d-dd73-4dcc-a99e-5662ab5e8174 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:54.963601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1042/2059] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:54.967750 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e31923-a911-4007-927e-c7deb6877c35 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:54.978401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e31923-a911-4007-927e-c7deb6877c35 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:54.984530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904aced-b831-4bb6-be50-5db8a268db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:54.985146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904aced-b831-4bb6-be50-5db8a268db15 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:54.985423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904aced-b831-4bb6-be50-5db8a268db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:54.985689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904aced-b831-4bb6-be50-5db8a268db15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:54.986387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904aced-b831-4bb6-be50-5db8a268db15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:54.987997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904aced-b831-4bb6-be50-5db8a268db15 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:55.004630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1018/2060] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:55.008805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6da5d-dd73-4dcc-a99e-5662ab5e8174 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:55.027460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6da5d-dd73-4dcc-a99e-5662ab5e8174 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:55.034545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22816e8d-0893-4031-b63f-18afc929d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:55.035210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22816e8d-0893-4031-b63f-18afc929d14f admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.035492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22816e8d-0893-4031-b63f-18afc929d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.035774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22816e8d-0893-4031-b63f-18afc929d14f admin admin] PATH_INFO: `/v3/projects/1c358d7210f3443fa4b2cf5c5c536de4/users/170a484e083b43d38c16a1126206c1aa/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.053759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22816e8d-0893-4031-b63f-18afc929d14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c358d7210f3443fa4b2cf5c5c536de4, user_id=170a484e083b43d38c16a1126206c1aa, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:55.056581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22816e8d-0893-4031-b63f-18afc929d14f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:55.073954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1043/2061] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:55 2022] PUT /identity/v3/projects/1c358d7210f3443fa4b2cf5c5c536de4/users/170a484e083b43d38c16a1126206c1aa/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:55.085315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c23c7-c810-4ee1-a76b-d64126bfbb3d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.085599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c23c7-c810-4ee1-a76b-d64126bfbb3d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.085867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c23c7-c810-4ee1-a76b-d64126bfbb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.114032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b26c23c7-c810-4ee1-a76b-d64126bfbb3d None None] MFA Rules not processed for user `170a484e083b43d38c16a1126206c1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:55.115291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b26c23c7-c810-4ee1-a76b-d64126bfbb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:55.192771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1019/2062] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:55.198756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22816e8d-0893-4031-b63f-18afc929d14f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:55.205469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:55.267238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22816e8d-0893-4031-b63f-18afc929d14f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:55.271908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859172ec-42b5-4d50-a4f1-1098ccc2806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:55.272545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859172ec-42b5-4d50-a4f1-1098ccc2806d admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.272826 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859172ec-42b5-4d50-a4f1-1098ccc2806d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.273104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859172ec-42b5-4d50-a4f1-1098ccc2806d admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.273771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859172ec-42b5-4d50-a4f1-1098ccc2806d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:55.275718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859172ec-42b5-4d50-a4f1-1098ccc2806d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:55.303011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1044/2063] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:55 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:55.307806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c23c7-c810-4ee1-a76b-d64126bfbb3d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:55.318673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c23c7-c810-4ee1-a76b-d64126bfbb3d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:55.379171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaba11-0869-49e9-b93f-e2073c002132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:55.379865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaba11-0869-49e9-b93f-e2073c002132 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.380172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaba11-0869-49e9-b93f-e2073c002132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.380445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaba11-0869-49e9-b93f-e2073c002132 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.381171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaba11-0869-49e9-b93f-e2073c002132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:55.383363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaba11-0869-49e9-b93f-e2073c002132 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:55.410944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1020/2064] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:55 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:09:55.411099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859172ec-42b5-4d50-a4f1-1098ccc2806d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:55.421522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859172ec-42b5-4d50-a4f1-1098ccc2806d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:55.426679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852935e-df23-4e3e-99d0-c3dd704b0735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:55.427445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852935e-df23-4e3e-99d0-c3dd704b0735 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.427729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852935e-df23-4e3e-99d0-c3dd704b0735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.428006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852935e-df23-4e3e-99d0-c3dd704b0735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.429300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852935e-df23-4e3e-99d0-c3dd704b0735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:55.430951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852935e-df23-4e3e-99d0-c3dd704b0735 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:55.442145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1045/2065] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:09:55.446029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaba11-0869-49e9-b93f-e2073c002132 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:55.456397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaba11-0869-49e9-b93f-e2073c002132 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:55.461060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c21f37-c975-478e-91a0-74a6e4c018a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:55.461670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21f37-c975-478e-91a0-74a6e4c018a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.461958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21f37-c975-478e-91a0-74a6e4c018a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.462232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21f37-c975-478e-91a0-74a6e4c018a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.462963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c21f37-c975-478e-91a0-74a6e4c018a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:55.464557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c21f37-c975-478e-91a0-74a6e4c018a8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:55.475707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1021/2066] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:55.479988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852935e-df23-4e3e-99d0-c3dd704b0735 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:55.490469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852935e-df23-4e3e-99d0-c3dd704b0735 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:55.495659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca831c-0232-4d16-85a3-124de2e60b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:55.496307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca831c-0232-4d16-85a3-124de2e60b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.496590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca831c-0232-4d16-85a3-124de2e60b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.496868 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca831c-0232-4d16-85a3-124de2e60b40 admin admin] PATH_INFO: `/v3/projects/a52d4cd928d84e319bce96f33fb1df88/users/649faebf11e94936a28be0aa8c0e4385/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.512246 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca831c-0232-4d16-85a3-124de2e60b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52d4cd928d84e319bce96f33fb1df88, user_id=649faebf11e94936a28be0aa8c0e4385, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:55.514981 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca831c-0232-4d16-85a3-124de2e60b40 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:55.527623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1046/2067] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:55 2022] PUT /identity/v3/projects/a52d4cd928d84e319bce96f33fb1df88/users/649faebf11e94936a28be0aa8c0e4385/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:55.538593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d2d10-7e18-47d0-8103-3535e44cbe00 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.538882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d2d10-7e18-47d0-8103-3535e44cbe00 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.539159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d2d10-7e18-47d0-8103-3535e44cbe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.559726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:55.571441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e45d2d10-7e18-47d0-8103-3535e44cbe00 None None] MFA Rules not processed for user `649faebf11e94936a28be0aa8c0e4385`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:55.572966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e45d2d10-7e18-47d0-8103-3535e44cbe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:55.645986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1022/2068] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:55.651284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca831c-0232-4d16-85a3-124de2e60b40 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:55.737680 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca831c-0232-4d16-85a3-124de2e60b40 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:55.744051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0efec-8672-4454-93cb-c6e099cd97ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:55.747557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0efec-8672-4454-93cb-c6e099cd97ba admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.749093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0efec-8672-4454-93cb-c6e099cd97ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.750643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0efec-8672-4454-93cb-c6e099cd97ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.751442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0efec-8672-4454-93cb-c6e099cd97ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:55.756506 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0efec-8672-4454-93cb-c6e099cd97ba admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:55.785620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1047/2069] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:55 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:55.790798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d2d10-7e18-47d0-8103-3535e44cbe00 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:55.805518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d2d10-7e18-47d0-8103-3535e44cbe00 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:55.880140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409fc05-206f-4634-b107-5fe896da827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:55.880768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409fc05-206f-4634-b107-5fe896da827b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.881064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409fc05-206f-4634-b107-5fe896da827b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.881448 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409fc05-206f-4634-b107-5fe896da827b admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.882128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409fc05-206f-4634-b107-5fe896da827b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:55.884196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409fc05-206f-4634-b107-5fe896da827b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:55.909945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1023/2070] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:55 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:55.918682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0efec-8672-4454-93cb-c6e099cd97ba admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:55.929941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0efec-8672-4454-93cb-c6e099cd97ba admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:55.934978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc25d4-b1a9-4179-b887-557d007e8468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:55.935643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc25d4-b1a9-4179-b887-557d007e8468 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.935936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc25d4-b1a9-4179-b887-557d007e8468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.936198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc25d4-b1a9-4179-b887-557d007e8468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.936897 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc25d4-b1a9-4179-b887-557d007e8468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:55.938618 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc25d4-b1a9-4179-b887-557d007e8468 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:55.954760 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1048/2071] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:55.961535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409fc05-206f-4634-b107-5fe896da827b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:55.972011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409fc05-206f-4634-b107-5fe896da827b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:55.976911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369b2b-0267-4461-ad9b-4853df40d1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:55.977593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369b2b-0267-4461-ad9b-4853df40d1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:55.977863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369b2b-0267-4461-ad9b-4853df40d1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:55.978147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369b2b-0267-4461-ad9b-4853df40d1f5 admin admin] PATH_INFO: `/v3/projects/50404f711f5a4a10861c697870c782e7/users/e164af904d27483c8c072f630a2b32ea/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:55.993230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea369b2b-0267-4461-ad9b-4853df40d1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50404f711f5a4a10861c697870c782e7, user_id=e164af904d27483c8c072f630a2b32ea, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:55.995947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea369b2b-0267-4461-ad9b-4853df40d1f5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:56.009690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1024/2072] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:55 2022] PUT /identity/v3/projects/50404f711f5a4a10861c697870c782e7/users/e164af904d27483c8c072f630a2b32ea/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:09:56.013786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc25d4-b1a9-4179-b887-557d007e8468 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:56.024516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc25d4-b1a9-4179-b887-557d007e8468 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:56.051618 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:56.101985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b390dc-dfc0-426a-ac7f-2a85d8cc44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:56.102961 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b390dc-dfc0-426a-ac7f-2a85d8cc44a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:56.103398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b390dc-dfc0-426a-ac7f-2a85d8cc44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:56.103871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b390dc-dfc0-426a-ac7f-2a85d8cc44a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:56.105356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b390dc-dfc0-426a-ac7f-2a85d8cc44a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:56.107658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b390dc-dfc0-426a-ac7f-2a85d8cc44a2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:56.123063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1049/2073] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:56.127280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369b2b-0267-4461-ad9b-4853df40d1f5 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:56.139381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369b2b-0267-4461-ad9b-4853df40d1f5 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:56.144142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a37e96-bfdf-40c4-a005-60e7cd17bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:56.144818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37e96-bfdf-40c4-a005-60e7cd17bd77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:56.145096 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37e96-bfdf-40c4-a005-60e7cd17bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:56.145369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37e96-bfdf-40c4-a005-60e7cd17bd77 admin admin] PATH_INFO: `/v3/projects/50404f711f5a4a10861c697870c782e7/users/e164af904d27483c8c072f630a2b32ea/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:56.147954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a37e96-bfdf-40c4-a005-60e7cd17bd77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50404f711f5a4a10861c697870c782e7, user_id=e164af904d27483c8c072f630a2b32ea, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:56.150634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a37e96-bfdf-40c4-a005-60e7cd17bd77 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:56.162349 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1025/2074] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:56 2022] PUT /identity/v3/projects/50404f711f5a4a10861c697870c782e7/users/e164af904d27483c8c072f630a2b32ea/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:56.173140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10562-2a9e-4cca-9170-690173c58c0b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:56.173377 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10562-2a9e-4cca-9170-690173c58c0b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:56.173655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10562-2a9e-4cca-9170-690173c58c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:56.207756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-09d10562-2a9e-4cca-9170-690173c58c0b None None] MFA Rules not processed for user `e164af904d27483c8c072f630a2b32ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:56.209176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-09d10562-2a9e-4cca-9170-690173c58c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:56.308653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1050/2075] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:56.325112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a37e96-bfdf-40c4-a005-60e7cd17bd77 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:56.325112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-48a37e96-bfdf-40c4-a005-60e7cd17bd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:56.417972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a37e96-bfdf-40c4-a005-60e7cd17bd77 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:56.422782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea9189-ef0f-449b-bb87-c867c11f4794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:56.423133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9189-ef0f-449b-bb87-c867c11f4794 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:56.424129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9189-ef0f-449b-bb87-c867c11f4794 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:56.424572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9189-ef0f-449b-bb87-c867c11f4794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:56.429969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:56.529623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea9189-ef0f-449b-bb87-c867c11f4794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:56.532315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea9189-ef0f-449b-bb87-c867c11f4794 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:56.543563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1026/2076] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:57.008637 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10562-2a9e-4cca-9170-690173c58c0b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:57.010306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-09d10562-2a9e-4cca-9170-690173c58c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:57.097413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10562-2a9e-4cca-9170-690173c58c0b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:57.104030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:57.104700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:57.105031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:57.105313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] PATH_INFO: `/v3/users/3c13808aaaaf489bbe05966ef40d7218` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:57.106543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c13808aaaaf489bbe05966ef40d7218)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:57.108510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:57.182108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c13808aaaaf489bbe05966ef40d7218'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:57.184829 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c13808aaaaf489bbe05966ef40d7218'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:57.191807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:57.198892 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c13808aaaaf489bbe05966ef40d7218'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:57.215319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c13808aaaaf489bbe05966ef40d7218'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:57.216019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c13808aaaaf489bbe05966ef40d7218'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:57.231089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1051/2077] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:57 2022] DELETE /identity/v3/users/3c13808aaaaf489bbe05966ef40d7218 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:57.235641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe4099-b04c-4123-a040-0e6f207722b5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:57.236144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe4099-b04c-4123-a040-0e6f207722b5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:57.236344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe4099-b04c-4123-a040-0e6f207722b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:57.256822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1bfe4099-b04c-4123-a040-0e6f207722b5 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:57.257957 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1bfe4099-b04c-4123-a040-0e6f207722b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:57.331400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1027/2078] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:57.346291 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:57.347983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:57.424360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efdac2-bee9-49b9-ab20-b18507ed6f1c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:57.428385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10541cb5-7f66-43e9-937d-bf6fb4a7f9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:57.429166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10541cb5-7f66-43e9-937d-bf6fb4a7f9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:57.429547 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10541cb5-7f66-43e9-937d-bf6fb4a7f9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:57.429920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10541cb5-7f66-43e9-937d-bf6fb4a7f9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:57.447644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10541cb5-7f66-43e9-937d-bf6fb4a7f9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:57.449581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10541cb5-7f66-43e9-937d-bf6fb4a7f9f4 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:57.464104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1052/2079] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:09:57.944322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe4099-b04c-4123-a040-0e6f207722b5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:57.946477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1bfe4099-b04c-4123-a040-0e6f207722b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:57.958229 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe4099-b04c-4123-a040-0e6f207722b5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:57.966399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:57.967629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:57.967977 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:57.968323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] PATH_INFO: `/v3/projects/6ce9bdd665064e2f84cd7701e5f6ae7e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:57.969586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce9bdd665064e2f84cd7701e5f6ae7e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:57.972087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:58.034376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce9bdd665064e2f84cd7701e5f6ae7e', 'request_id': 'req-e623499a-d1cb-4275-96e0-db75453a92e6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:58.048756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce9bdd665064e2f84cd7701e5f6ae7e', 'request_id': 'req-e623499a-d1cb-4275-96e0-db75453a92e6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:58.055866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce9bdd665064e2f84cd7701e5f6ae7e', 'request_id': 'req-e623499a-d1cb-4275-96e0-db75453a92e6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:58.072187 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] The token cache is being invalidate because project 6ce9bdd665064e2f84cd7701e5f6ae7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:58.073281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:58.076466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:58.079262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1028/2080] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:57 2022] DELETE /identity/v3/projects/6ce9bdd665064e2f84cd7701e5f6ae7e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:58.083632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10541cb5-7f66-43e9-937d-bf6fb4a7f9f4 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:58.096199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10541cb5-7f66-43e9-937d-bf6fb4a7f9f4 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:58.186696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:58.187264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:58.187546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:58.187849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] PATH_INFO: `/v3/users/eb446ff6477a4873af83f3dbe9b678f4` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:58.189123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb446ff6477a4873af83f3dbe9b678f4)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:58.191537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:58.251159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb446ff6477a4873af83f3dbe9b678f4'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:58.251888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb446ff6477a4873af83f3dbe9b678f4'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:58.253993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:58.256033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:58.272969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb446ff6477a4873af83f3dbe9b678f4'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:58.307286 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:58.308793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb446ff6477a4873af83f3dbe9b678f4'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:58.309659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb446ff6477a4873af83f3dbe9b678f4'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:58.311243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:58.343971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1053/2081] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:09:58 2022] DELETE /identity/v3/users/eb446ff6477a4873af83f3dbe9b678f4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:58.373390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623499a-d1cb-4275-96e0-db75453a92e6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:58.553017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb56de4-8044-4892-8547-a0b847b70cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:58.555105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56de4-8044-4892-8547-a0b847b70cbe service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:58.555393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56de4-8044-4892-8547-a0b847b70cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:58.556033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56de4-8044-4892-8547-a0b847b70cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:58.558930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9bb56de4-8044-4892-8547-a0b847b70cbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:58.642129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb56de4-8044-4892-8547-a0b847b70cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:58.655490 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb56de4-8044-4892-8547-a0b847b70cbe service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:58.684927 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1029/2082] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:09:58.943575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:58.945609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:59.069384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed4c0e-53c9-4dde-b76f-e0031106f36b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:59.085568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:59.088590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:59.089289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:59.089289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] PATH_INFO: `/v3/projects/02b5afc1981d4ee69ceaba624bac7b47` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:59.090639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b5afc1981d4ee69ceaba624bac7b47)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:59.092677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:59.196216 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b5afc1981d4ee69ceaba624bac7b47', 'request_id': 'req-ebb6a113-0c3d-47e7-af81-f982d68258af'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:59.206413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b5afc1981d4ee69ceaba624bac7b47', 'request_id': 'req-ebb6a113-0c3d-47e7-af81-f982d68258af'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:59.214021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b5afc1981d4ee69ceaba624bac7b47', 'request_id': 'req-ebb6a113-0c3d-47e7-af81-f982d68258af'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:59.227880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] The token cache is being invalidate because project 02b5afc1981d4ee69ceaba624bac7b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:09:59.228258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:59.230004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ebb6a113-0c3d-47e7-af81-f982d68258af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:09:59.232012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1054/2083] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:09:58 2022] DELETE /identity/v3/projects/02b5afc1981d4ee69ceaba624bac7b47 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:09:59.238478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19501-2041-456d-8884-28793ba0a50d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:59.238909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19501-2041-456d-8884-28793ba0a50d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:59.239901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19501-2041-456d-8884-28793ba0a50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:59.276426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-88c19501-2041-456d-8884-28793ba0a50d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:59.279288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-88c19501-2041-456d-8884-28793ba0a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:59.394186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1030/2084] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:09:59.404543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93c04a-e321-426d-ab00-1f38dc210610 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:59.405478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93c04a-e321-426d-ab00-1f38dc210610 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:59.405980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93c04a-e321-426d-ab00-1f38dc210610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:59.441984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-8d93c04a-e321-426d-ab00-1f38dc210610 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:09:59.443933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8d93c04a-e321-426d-ab00-1f38dc210610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:59.454094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1055/2085] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:09:59.458276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19501-2041-456d-8884-28793ba0a50d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:59.482410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19501-2041-456d-8884-28793ba0a50d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:59.489233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36e036-b985-42d8-ae4f-0199f5540876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:59.490805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36e036-b985-42d8-ae4f-0199f5540876 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:59.491294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36e036-b985-42d8-ae4f-0199f5540876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:59.491753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36e036-b985-42d8-ae4f-0199f5540876 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:59.493654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36e036-b985-42d8-ae4f-0199f5540876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:09:59.494391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36e036-b985-42d8-ae4f-0199f5540876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:59.496734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36e036-b985-42d8-ae4f-0199f5540876 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:59.523344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1031/2086] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 02:09:59.527779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93c04a-e321-426d-ab00-1f38dc210610 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:59.541018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93c04a-e321-426d-ab00-1f38dc210610 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:59.547944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e726a0-9bbf-4491-9d32-e7af54838c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:59.548659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e726a0-9bbf-4491-9d32-e7af54838c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:59.549039 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e726a0-9bbf-4491-9d32-e7af54838c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:59.549316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e726a0-9bbf-4491-9d32-e7af54838c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:59.550201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e726a0-9bbf-4491-9d32-e7af54838c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:59.553002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e726a0-9bbf-4491-9d32-e7af54838c73 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:59.603895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1056/2087] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:09:59 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:59.608040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36e036-b985-42d8-ae4f-0199f5540876 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:59.624827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36e036-b985-42d8-ae4f-0199f5540876 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:59.647973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e726a0-9bbf-4491-9d32-e7af54838c73 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:59.649733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f3e726a0-9bbf-4491-9d32-e7af54838c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:59.663610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:59.715168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1cd7d-356d-4ef2-9777-b0164214eac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:59.716066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1cd7d-356d-4ef2-9777-b0164214eac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:59.716502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1cd7d-356d-4ef2-9777-b0164214eac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:59.716926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1cd7d-356d-4ef2-9777-b0164214eac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:59.717740 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1cd7d-356d-4ef2-9777-b0164214eac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:59.720000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1cd7d-356d-4ef2-9777-b0164214eac1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:59.739394 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e726a0-9bbf-4491-9d32-e7af54838c73 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:59.743617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdd674-57c3-4e69-a443-e70a11dcc3ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:59.744261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdd674-57c3-4e69-a443-e70a11dcc3ff service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:59.746537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1032/2088] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:09:59 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:09:59.746687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdd674-57c3-4e69-a443-e70a11dcc3ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:59.746687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdd674-57c3-4e69-a443-e70a11dcc3ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:59.747095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-12bdd674-57c3-4e69-a443-e70a11dcc3ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:09:59.748707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1cd7d-356d-4ef2-9777-b0164214eac1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:59.752715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:09:59.764115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1cd7d-356d-4ef2-9777-b0164214eac1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:59.769899 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda811-559e-48c2-ad19-ac878c375b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:59.770615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda811-559e-48c2-ad19-ac878c375b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:59.770958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda811-559e-48c2-ad19-ac878c375b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:59.771296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda811-559e-48c2-ad19-ac878c375b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:59.772660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdda811-559e-48c2-ad19-ac878c375b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:59.776001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdda811-559e-48c2-ad19-ac878c375b02 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:59.804187 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1033/2089] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:59.808401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda811-559e-48c2-ad19-ac878c375b02 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:59.823125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda811-559e-48c2-ad19-ac878c375b02 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:59.830709 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7357a-aa0c-40d4-a041-f0aae3f23ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:59.831484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7357a-aa0c-40d4-a041-f0aae3f23ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:59.831859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7357a-aa0c-40d4-a041-f0aae3f23ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:59.832229 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7357a-aa0c-40d4-a041-f0aae3f23ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:59.833165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7357a-aa0c-40d4-a041-f0aae3f23ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:59.836223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdd674-57c3-4e69-a443-e70a11dcc3ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:59.836897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7357a-aa0c-40d4-a041-f0aae3f23ed7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:59.838108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdd674-57c3-4e69-a443-e70a11dcc3ff service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:09:59.850515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1057/2090] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:09:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:09:59.855774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1034/2091] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:09:59.872824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdd674-57c3-4e69-a443-e70a11dcc3ff service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:09:59.907650 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdd674-57c3-4e69-a443-e70a11dcc3ff service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:09:59.924756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560b02e-50b3-421c-a552-6e0add854fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:09:59.925714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b02e-50b3-421c-a552-6e0add854fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:09:59.926153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b02e-50b3-421c-a552-6e0add854fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:09:59.926624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b02e-50b3-421c-a552-6e0add854fa2 admin admin] PATH_INFO: `/v3/projects/8c97fbc5fba84308a7f5c2314b88d7a9/users/daa6ec73dddd4afabd94a1060635303c/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:09:59.962059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560b02e-50b3-421c-a552-6e0add854fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c97fbc5fba84308a7f5c2314b88d7a9, user_id=daa6ec73dddd4afabd94a1060635303c, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:09:59.966347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560b02e-50b3-421c-a552-6e0add854fa2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:00.012050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1058/2092] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:09:59 2022] PUT /identity/v3/projects/8c97fbc5fba84308a7f5c2314b88d7a9/users/daa6ec73dddd4afabd94a1060635303c/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:00.013190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf4be-ee1f-430f-84ce-c149779c0c55 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:00.013672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf4be-ee1f-430f-84ce-c149779c0c55 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:00.014110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf4be-ee1f-430f-84ce-c149779c0c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:00.098705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cc4bf4be-ee1f-430f-84ce-c149779c0c55 None None] MFA Rules not processed for user `daa6ec73dddd4afabd94a1060635303c`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:00.100275 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cc4bf4be-ee1f-430f-84ce-c149779c0c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:00.184673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1035/2093] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:00.189695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560b02e-50b3-421c-a552-6e0add854fa2 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:00.257599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560b02e-50b3-421c-a552-6e0add854fa2 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:00.262311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac638b5-b5b5-4eca-b6c2-bf0b4a4bf391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:00.262969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac638b5-b5b5-4eca-b6c2-bf0b4a4bf391 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:00.263252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac638b5-b5b5-4eca-b6c2-bf0b4a4bf391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:00.263527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac638b5-b5b5-4eca-b6c2-bf0b4a4bf391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:00.264190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac638b5-b5b5-4eca-b6c2-bf0b4a4bf391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:00.266129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac638b5-b5b5-4eca-b6c2-bf0b4a4bf391 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:00.292158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1059/2094] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:00 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:00.296459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf4be-ee1f-430f-84ce-c149779c0c55 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:00.307952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf4be-ee1f-430f-84ce-c149779c0c55 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:00.368872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a8818-160e-4098-bf1a-66b2520936fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:00.369415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a8818-160e-4098-bf1a-66b2520936fc admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:00.369696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a8818-160e-4098-bf1a-66b2520936fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:00.369971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a8818-160e-4098-bf1a-66b2520936fc admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:00.370723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a8818-160e-4098-bf1a-66b2520936fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:00.372589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a8818-160e-4098-bf1a-66b2520936fc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:00.395743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1036/2095] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:00 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:00.399595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac638b5-b5b5-4eca-b6c2-bf0b4a4bf391 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:00.410644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac638b5-b5b5-4eca-b6c2-bf0b4a4bf391 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:00.417357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820f133-5135-4de9-8017-e0f04b6287c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:00.418120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820f133-5135-4de9-8017-e0f04b6287c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:00.418540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820f133-5135-4de9-8017-e0f04b6287c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:00.418867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820f133-5135-4de9-8017-e0f04b6287c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:00.419763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820f133-5135-4de9-8017-e0f04b6287c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:00.421563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820f133-5135-4de9-8017-e0f04b6287c4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:00.434030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1060/2096] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:00.438127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a8818-160e-4098-bf1a-66b2520936fc admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:00.449430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a8818-160e-4098-bf1a-66b2520936fc admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:00.455014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc3f7-f376-4f24-851f-23ee5790a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:00.455762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc3f7-f376-4f24-851f-23ee5790a0be admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:00.456335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc3f7-f376-4f24-851f-23ee5790a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:00.456653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc3f7-f376-4f24-851f-23ee5790a0be admin admin] PATH_INFO: `/v3/projects/d3d7b59f11d5451c87ce8e8d7b9a21ac/users/7e822143c41e4293a5e12f94e7c654ca/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:00.469218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:00.476849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcc3f7-f376-4f24-851f-23ee5790a0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d7b59f11d5451c87ce8e8d7b9a21ac, user_id=7e822143c41e4293a5e12f94e7c654ca, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:00.479902 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcc3f7-f376-4f24-851f-23ee5790a0be admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:00.501802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1037/2097] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:00 2022] PUT /identity/v3/projects/d3d7b59f11d5451c87ce8e8d7b9a21ac/users/7e822143c41e4293a5e12f94e7c654ca/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:00.505800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820f133-5135-4de9-8017-e0f04b6287c4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:00.517746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820f133-5135-4de9-8017-e0f04b6287c4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:00.573207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:00.585854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be2fd3-cc05-48d5-a886-57a9d8963d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:00.587324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be2fd3-cc05-48d5-a886-57a9d8963d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:00.587718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be2fd3-cc05-48d5-a886-57a9d8963d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:00.588349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be2fd3-cc05-48d5-a886-57a9d8963d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:00.589172 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be2fd3-cc05-48d5-a886-57a9d8963d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:00.591147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be2fd3-cc05-48d5-a886-57a9d8963d6b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:00.615251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1061/2098] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:00.617027 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc3f7-f376-4f24-851f-23ee5790a0be admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:00.627619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc3f7-f376-4f24-851f-23ee5790a0be admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:00.632368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e41a9-7513-4be2-9db3-d0fce31f7b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:00.633039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e41a9-7513-4be2-9db3-d0fce31f7b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:00.633318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e41a9-7513-4be2-9db3-d0fce31f7b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:00.633594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e41a9-7513-4be2-9db3-d0fce31f7b73 admin admin] PATH_INFO: `/v3/projects/d3d7b59f11d5451c87ce8e8d7b9a21ac/users/7e822143c41e4293a5e12f94e7c654ca/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:00.635628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e41a9-7513-4be2-9db3-d0fce31f7b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d7b59f11d5451c87ce8e8d7b9a21ac, user_id=7e822143c41e4293a5e12f94e7c654ca, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:00.638266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e41a9-7513-4be2-9db3-d0fce31f7b73 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:00.650990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1038/2099] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:00 2022] PUT /identity/v3/projects/d3d7b59f11d5451c87ce8e8d7b9a21ac/users/7e822143c41e4293a5e12f94e7c654ca/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:00.662194 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6082db0-a16a-4031-a9b0-87f296b03c77 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:00.663045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6082db0-a16a-4031-a9b0-87f296b03c77 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:00.663329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6082db0-a16a-4031-a9b0-87f296b03c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:00.693582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-c6082db0-a16a-4031-a9b0-87f296b03c77 None None] MFA Rules not processed for user `7e822143c41e4293a5e12f94e7c654ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:00.694907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c6082db0-a16a-4031-a9b0-87f296b03c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:00.766187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1062/2100] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:00.777788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e41a9-7513-4be2-9db3-d0fce31f7b73 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:00.845902 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e41a9-7513-4be2-9db3-d0fce31f7b73 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:00.849814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f86f30-a858-482f-a68c-eaa688b1507a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:00.851059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f86f30-a858-482f-a68c-eaa688b1507a service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:00.851340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f86f30-a858-482f-a68c-eaa688b1507a service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:00.851639 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f86f30-a858-482f-a68c-eaa688b1507a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:00.931764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f86f30-a858-482f-a68c-eaa688b1507a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:00.933221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f86f30-a858-482f-a68c-eaa688b1507a service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:00.943314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1039/2101] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:04.247556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6082db0-a16a-4031-a9b0-87f296b03c77 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:04.248986 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c6082db0-a16a-4031-a9b0-87f296b03c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:04.321456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6082db0-a16a-4031-a9b0-87f296b03c77 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:04.325957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:04.326647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:04.326929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:04.327204 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] PATH_INFO: `/v3/users/170a484e083b43d38c16a1126206c1aa` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:04.328359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=170a484e083b43d38c16a1126206c1aa)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:04.330279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:04.376048 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170a484e083b43d38c16a1126206c1aa'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:04.376687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170a484e083b43d38c16a1126206c1aa'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:04.383816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170a484e083b43d38c16a1126206c1aa'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:04.396298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170a484e083b43d38c16a1126206c1aa'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:04.396930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170a484e083b43d38c16a1126206c1aa'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:04.399162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:04.411905 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1063/2102] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:04 2022] DELETE /identity/v3/users/170a484e083b43d38c16a1126206c1aa => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:04.417108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d90c3-8d1e-4a7d-b08f-2e747a9835c0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:04.417564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d90c3-8d1e-4a7d-b08f-2e747a9835c0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:04.417674 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d90c3-8d1e-4a7d-b08f-2e747a9835c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:04.436845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-aa1d90c3-8d1e-4a7d-b08f-2e747a9835c0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:04.438044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aa1d90c3-8d1e-4a7d-b08f-2e747a9835c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:04.498432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1040/2103] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:04.504863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:04.506358 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:04.563227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f252884-74cb-42a2-bb35-5bead7006a48 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:04.567042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd5447-2c3e-4707-87e0-67fb1b83bdc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:04.567757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd5447-2c3e-4707-87e0-67fb1b83bdc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:04.568038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd5447-2c3e-4707-87e0-67fb1b83bdc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:04.568500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd5447-2c3e-4707-87e0-67fb1b83bdc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:04.577335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd5447-2c3e-4707-87e0-67fb1b83bdc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:04.578827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd5447-2c3e-4707-87e0-67fb1b83bdc0 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:04.588992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1064/2104] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:04.881570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d90c3-8d1e-4a7d-b08f-2e747a9835c0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:04.883056 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aa1d90c3-8d1e-4a7d-b08f-2e747a9835c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:04.897552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d90c3-8d1e-4a7d-b08f-2e747a9835c0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:04.915786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:04.916441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:04.916723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:04.916996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] PATH_INFO: `/v3/projects/1c358d7210f3443fa4b2cf5c5c536de4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:04.918231 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c358d7210f3443fa4b2cf5c5c536de4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:04.920329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:04.951175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:04.969978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c358d7210f3443fa4b2cf5c5c536de4', 'request_id': 'req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:04.975564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c358d7210f3443fa4b2cf5c5c536de4', 'request_id': 'req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:04.981882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c358d7210f3443fa4b2cf5c5c536de4', 'request_id': 'req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:04.993981 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] The token cache is being invalidate because project 1c358d7210f3443fa4b2cf5c5c536de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:04.994267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:04.994931 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:04.996442 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1041/2105] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:04 2022] DELETE /identity/v3/projects/1c358d7210f3443fa4b2cf5c5c536de4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:05.000499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd5447-2c3e-4707-87e0-67fb1b83bdc0 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:05.010523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd5447-2c3e-4707-87e0-67fb1b83bdc0 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:05.066243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:05.066908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:05.067188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:05.067464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] PATH_INFO: `/v3/users/649faebf11e94936a28be0aa8c0e4385` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:05.069131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=649faebf11e94936a28be0aa8c0e4385)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:05.071099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:05.116630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649faebf11e94936a28be0aa8c0e4385'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.117233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649faebf11e94936a28be0aa8c0e4385'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.124503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649faebf11e94936a28be0aa8c0e4385'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.140055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649faebf11e94936a28be0aa8c0e4385'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.140763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649faebf11e94936a28be0aa8c0e4385'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.153718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1065/2106] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:04 2022] DELETE /identity/v3/users/649faebf11e94936a28be0aa8c0e4385 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:05.398635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:05.401294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:05.481656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb997bf-7ca2-4d80-b1ad-7c9759ecb4d3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:05.504750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:05.506360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:05.522495 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:05.548567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae262dc-1771-4a5b-8ae2-a5fca392283f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:05.549190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae262dc-1771-4a5b-8ae2-a5fca392283f service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:05.549472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae262dc-1771-4a5b-8ae2-a5fca392283f service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:05.549746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae262dc-1771-4a5b-8ae2-a5fca392283f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:05.551907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3ae262dc-1771-4a5b-8ae2-a5fca392283f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:05.582600 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b24f6-b2f0-47d1-8ace-b62252374193 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:05.587801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:05.588429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:05.588716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:05.588987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] PATH_INFO: `/v3/projects/a52d4cd928d84e319bce96f33fb1df88` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:05.590260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52d4cd928d84e319bce96f33fb1df88)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:05.592317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:05.614751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae262dc-1771-4a5b-8ae2-a5fca392283f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:05.616200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae262dc-1771-4a5b-8ae2-a5fca392283f service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:05.626031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1042/2107] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:05.639292 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52d4cd928d84e319bce96f33fb1df88', 'request_id': 'req-32ceb28d-6f38-4549-b255-497a3f993aa2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.647968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52d4cd928d84e319bce96f33fb1df88', 'request_id': 'req-32ceb28d-6f38-4549-b255-497a3f993aa2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.654395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52d4cd928d84e319bce96f33fb1df88', 'request_id': 'req-32ceb28d-6f38-4549-b255-497a3f993aa2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.666223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] The token cache is being invalidate because project a52d4cd928d84e319bce96f33fb1df88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:05.666538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.667206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.669085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1066/2108] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:05 2022] DELETE /identity/v3/projects/a52d4cd928d84e319bce96f33fb1df88 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:10:05.673366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae262dc-1771-4a5b-8ae2-a5fca392283f service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:05.684546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae262dc-1771-4a5b-8ae2-a5fca392283f service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:05.701438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:05.746563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:05.747284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:05.747650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:05.747956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] PATH_INFO: `/v3/users/e164af904d27483c8c072f630a2b32ea` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:05.749290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e164af904d27483c8c072f630a2b32ea)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:05.751264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:05.801312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e164af904d27483c8c072f630a2b32ea'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.802098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e164af904d27483c8c072f630a2b32ea'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.810730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e164af904d27483c8c072f630a2b32ea'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.824530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e164af904d27483c8c072f630a2b32ea'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.825203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-efc153e9-4f84-4415-b784-cffc8d97853c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e164af904d27483c8c072f630a2b32ea'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:05.840169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1043/2109] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:05 2022] DELETE /identity/v3/users/e164af904d27483c8c072f630a2b32ea => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:06.218228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:06.219833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:06.234850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceb28d-6f38-4549-b255-497a3f993aa2 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:06.293074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:06.293726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:06.294012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:06.294287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] PATH_INFO: `/v3/projects/50404f711f5a4a10861c697870c782e7` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:06.295553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50404f711f5a4a10861c697870c782e7)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:06.297486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:06.344360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:06.348102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50404f711f5a4a10861c697870c782e7', 'request_id': 'req-2f685550-8598-43c6-bd50-51cc7ee5b24d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:06.355915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50404f711f5a4a10861c697870c782e7', 'request_id': 'req-2f685550-8598-43c6-bd50-51cc7ee5b24d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:06.364354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50404f711f5a4a10861c697870c782e7', 'request_id': 'req-2f685550-8598-43c6-bd50-51cc7ee5b24d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:06.376599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] The token cache is being invalidate because project 50404f711f5a4a10861c697870c782e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:06.376887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:06.377547 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2f685550-8598-43c6-bd50-51cc7ee5b24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:06.379098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1067/2110] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:06 2022] DELETE /identity/v3/projects/50404f711f5a4a10861c697870c782e7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:06.384866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8753ad-d6f0-4d4a-965b-8d6f282a8ef7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:06.385095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8753ad-d6f0-4d4a-965b-8d6f282a8ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:06.385373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8753ad-d6f0-4d4a-965b-8d6f282a8ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:06.404700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2d8753ad-d6f0-4d4a-965b-8d6f282a8ef7 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:06.405909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2d8753ad-d6f0-4d4a-965b-8d6f282a8ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:06.464730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1044/2111] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:06.472580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a23d10-45c9-4c48-8078-048f09de1cf8 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:06.472873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a23d10-45c9-4c48-8078-048f09de1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:06.473150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a23d10-45c9-4c48-8078-048f09de1cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:06.494490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-61a23d10-45c9-4c48-8078-048f09de1cf8 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:06.495718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-61a23d10-45c9-4c48-8078-048f09de1cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:06.503976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1068/2112] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:06.508768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8753ad-d6f0-4d4a-965b-8d6f282a8ef7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:06.520074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8753ad-d6f0-4d4a-965b-8d6f282a8ef7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:06.525093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe8fbe-912c-42f7-b72f-1faf0948ae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:06.525763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe8fbe-912c-42f7-b72f-1faf0948ae48 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:06.526194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe8fbe-912c-42f7-b72f-1faf0948ae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:06.526510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe8fbe-912c-42f7-b72f-1faf0948ae48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:06.527225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe8fbe-912c-42f7-b72f-1faf0948ae48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:10:06.527531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe8fbe-912c-42f7-b72f-1faf0948ae48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:06.529326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe8fbe-912c-42f7-b72f-1faf0948ae48 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:06.546878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1045/2113] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 02:10:06.551497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a23d10-45c9-4c48-8078-048f09de1cf8 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:06.562103 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a23d10-45c9-4c48-8078-048f09de1cf8 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:06.567556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d48c5-61aa-486d-a6da-7cab91639e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:06.568377 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d48c5-61aa-486d-a6da-7cab91639e2d admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:06.568837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d48c5-61aa-486d-a6da-7cab91639e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:06.569255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d48c5-61aa-486d-a6da-7cab91639e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:06.570235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d48c5-61aa-486d-a6da-7cab91639e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:06.572235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d48c5-61aa-486d-a6da-7cab91639e2d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:06.602530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1069/2114] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:06 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:06.606794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe8fbe-912c-42f7-b72f-1faf0948ae48 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:06.628095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe8fbe-912c-42f7-b72f-1faf0948ae48 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:06.652016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:06.687996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e9aa8-8384-4ee3-93eb-8eccc42126f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:06.688611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e9aa8-8384-4ee3-93eb-8eccc42126f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:06.688893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e9aa8-8384-4ee3-93eb-8eccc42126f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:06.689167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e9aa8-8384-4ee3-93eb-8eccc42126f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:06.690083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e9aa8-8384-4ee3-93eb-8eccc42126f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:06.692040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e9aa8-8384-4ee3-93eb-8eccc42126f2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:06.712432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1046/2115] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:06 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:06.716641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d48c5-61aa-486d-a6da-7cab91639e2d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:06.727452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d48c5-61aa-486d-a6da-7cab91639e2d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:06.732040 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bc96f-879f-4077-a4f9-72f78b6a8753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:06.732647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bc96f-879f-4077-a4f9-72f78b6a8753 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:06.732932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bc96f-879f-4077-a4f9-72f78b6a8753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:06.733210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bc96f-879f-4077-a4f9-72f78b6a8753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:06.733910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bc96f-879f-4077-a4f9-72f78b6a8753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:06.735562 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bc96f-879f-4077-a4f9-72f78b6a8753 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:06.745956 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1070/2116] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:06.749848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e9aa8-8384-4ee3-93eb-8eccc42126f2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:06.759995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e9aa8-8384-4ee3-93eb-8eccc42126f2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:06.764557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5167cd-45f1-44fa-a398-c04051bbc2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:06.765163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5167cd-45f1-44fa-a398-c04051bbc2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:06.765444 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5167cd-45f1-44fa-a398-c04051bbc2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:06.765715 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5167cd-45f1-44fa-a398-c04051bbc2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:06.766405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5167cd-45f1-44fa-a398-c04051bbc2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:06.768013 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5167cd-45f1-44fa-a398-c04051bbc2fc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:06.778391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1047/2117] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:06.782417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bc96f-879f-4077-a4f9-72f78b6a8753 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:06.793009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bc96f-879f-4077-a4f9-72f78b6a8753 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:06.797783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6277d-ab97-45d1-8d66-2fd39e8ac9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:06.798431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6277d-ab97-45d1-8d66-2fd39e8ac9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:06.798761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6277d-ab97-45d1-8d66-2fd39e8ac9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:06.799020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6277d-ab97-45d1-8d66-2fd39e8ac9fe admin admin] PATH_INFO: `/v3/projects/dc72d1ffc73348e7bd280f5b8ab78c22/users/b90cb62ab0a643ea939e00f81fea1b96/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:06.814755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6277d-ab97-45d1-8d66-2fd39e8ac9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc72d1ffc73348e7bd280f5b8ab78c22, user_id=b90cb62ab0a643ea939e00f81fea1b96, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:06.817412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6277d-ab97-45d1-8d66-2fd39e8ac9fe admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:06.829800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1071/2118] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:06 2022] PUT /identity/v3/projects/dc72d1ffc73348e7bd280f5b8ab78c22/users/b90cb62ab0a643ea939e00f81fea1b96/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:06.835779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c639-26a9-4010-a60c-1255b3c09367 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:06.836135 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c639-26a9-4010-a60c-1255b3c09367 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:06.836870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c639-26a9-4010-a60c-1255b3c09367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:06.856883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0fd4c639-26a9-4010-a60c-1255b3c09367 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:06.858151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0fd4c639-26a9-4010-a60c-1255b3c09367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:06.926119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1048/2119] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:06.936284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6277d-ab97-45d1-8d66-2fd39e8ac9fe admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:06.938137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b4b6277d-ab97-45d1-8d66-2fd39e8ac9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:07.014602 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6277d-ab97-45d1-8d66-2fd39e8ac9fe admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:07.019176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f240209-d954-4302-9fc1-88156957ac9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:07.019846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f240209-d954-4302-9fc1-88156957ac9c service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:07.020127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f240209-d954-4302-9fc1-88156957ac9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:07.020398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f240209-d954-4302-9fc1-88156957ac9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:07.034104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f240209-d954-4302-9fc1-88156957ac9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:07.035748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f240209-d954-4302-9fc1-88156957ac9c service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:07.047861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1072/2120] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:10:07.863222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a8ba-256a-44e8-a847-b335dcf81ff0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:07.863682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a8ba-256a-44e8-a847-b335dcf81ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:07.863954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a8ba-256a-44e8-a847-b335dcf81ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:07.908842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9291a8ba-256a-44e8-a847-b335dcf81ff0 None None] MFA Rules not processed for user `b90cb62ab0a643ea939e00f81fea1b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:07.910073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9291a8ba-256a-44e8-a847-b335dcf81ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:07.980639 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1049/2121] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:07.991662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f240209-d954-4302-9fc1-88156957ac9c service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:07.993153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-1f240209-d954-4302-9fc1-88156957ac9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:08.055457 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f240209-d954-4302-9fc1-88156957ac9c service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:08.059250 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18c95c-815c-49eb-8fb3-40179a5d001d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:08.059940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18c95c-815c-49eb-8fb3-40179a5d001d service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:08.060282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18c95c-815c-49eb-8fb3-40179a5d001d service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:08.060640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18c95c-815c-49eb-8fb3-40179a5d001d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:08.070032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18c95c-815c-49eb-8fb3-40179a5d001d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:08.071504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18c95c-815c-49eb-8fb3-40179a5d001d service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:08.080460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1073/2122] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:10.512227 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c65e7-b1ff-485c-a64a-4ded35bcd527 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:10.512728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c65e7-b1ff-485c-a64a-4ded35bcd527 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:10.512820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c65e7-b1ff-485c-a64a-4ded35bcd527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:10.532334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-464c65e7-b1ff-485c-a64a-4ded35bcd527 None None] MFA Rules not processed for user `b90cb62ab0a643ea939e00f81fea1b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:10.533524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-464c65e7-b1ff-485c-a64a-4ded35bcd527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:10.540400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1050/2123] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:10.700428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18c95c-815c-49eb-8fb3-40179a5d001d service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:10.701896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-be18c95c-815c-49eb-8fb3-40179a5d001d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:10.716044 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18c95c-815c-49eb-8fb3-40179a5d001d service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:10.721087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:10.721714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:10.721989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:10.722261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] PATH_INFO: `/v3/users/daa6ec73dddd4afabd94a1060635303c` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:10.723469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa6ec73dddd4afabd94a1060635303c)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:10.725451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:10.738076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:10.781383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa6ec73dddd4afabd94a1060635303c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:10.781868 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa6ec73dddd4afabd94a1060635303c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:10.790869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa6ec73dddd4afabd94a1060635303c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:10.805823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa6ec73dddd4afabd94a1060635303c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:10.806582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa6ec73dddd4afabd94a1060635303c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:10.823056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1074/2124] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:10 2022] DELETE /identity/v3/users/daa6ec73dddd4afabd94a1060635303c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:10.827565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5240d1-37fe-4187-bb38-9e81df36a74b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:10.827858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5240d1-37fe-4187-bb38-9e81df36a74b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:10.828138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5240d1-37fe-4187-bb38-9e81df36a74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:10.847728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4d5240d1-37fe-4187-bb38-9e81df36a74b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:10.849065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4d5240d1-37fe-4187-bb38-9e81df36a74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:10.877570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:10.915728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1051/2125] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:10.925697 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:10.927290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:10.989233 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6250c10-ef89-4a7a-a241-a66ead4a9070 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:10.993508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6aa65-a031-4a50-8715-b192b7cedce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:10.994134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa65-a031-4a50-8715-b192b7cedce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:10.994414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa65-a031-4a50-8715-b192b7cedce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:10.994727 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa65-a031-4a50-8715-b192b7cedce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:11.004139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6aa65-a031-4a50-8715-b192b7cedce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:11.005574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6aa65-a031-4a50-8715-b192b7cedce2 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:11.017474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1075/2126] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:11.298198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5240d1-37fe-4187-bb38-9e81df36a74b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:11.299695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4d5240d1-37fe-4187-bb38-9e81df36a74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:11.315212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5240d1-37fe-4187-bb38-9e81df36a74b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:11.321446 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:11.321858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:11.322146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:11.322423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] PATH_INFO: `/v3/projects/8c97fbc5fba84308a7f5c2314b88d7a9` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:11.324030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c97fbc5fba84308a7f5c2314b88d7a9)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:11.325647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:11.379646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c97fbc5fba84308a7f5c2314b88d7a9', 'request_id': 'req-67189498-d09a-49d7-a560-d98bed948bb1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:11.386697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c97fbc5fba84308a7f5c2314b88d7a9', 'request_id': 'req-67189498-d09a-49d7-a560-d98bed948bb1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:11.393761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c97fbc5fba84308a7f5c2314b88d7a9', 'request_id': 'req-67189498-d09a-49d7-a560-d98bed948bb1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:11.407495 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] The token cache is being invalidate because project 8c97fbc5fba84308a7f5c2314b88d7a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:11.407784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:11.408406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:11.409971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1052/2127] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:11 2022] DELETE /identity/v3/projects/8c97fbc5fba84308a7f5c2314b88d7a9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:11.413947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6aa65-a031-4a50-8715-b192b7cedce2 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:11.424800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6aa65-a031-4a50-8715-b192b7cedce2 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:11.487089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:11.487830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:11.488204 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:11.488557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] PATH_INFO: `/v3/users/7e822143c41e4293a5e12f94e7c654ca` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:11.490007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e822143c41e4293a5e12f94e7c654ca)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:11.492694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:11.539014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:11.555405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e822143c41e4293a5e12f94e7c654ca'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:11.556259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e822143c41e4293a5e12f94e7c654ca'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:11.564267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e822143c41e4293a5e12f94e7c654ca'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:11.577731 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e822143c41e4293a5e12f94e7c654ca'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:11.578403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0f325fc3-53af-4948-8605-f3a9734f341a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e822143c41e4293a5e12f94e7c654ca'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:11.590570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1076/2128] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:11 2022] DELETE /identity/v3/users/7e822143c41e4293a5e12f94e7c654ca => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:11.956896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:11.958413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:11.971935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67189498-d09a-49d7-a560-d98bed948bb1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:12.042675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:12.043335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:12.043619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:12.043943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] PATH_INFO: `/v3/projects/d3d7b59f11d5451c87ce8e8d7b9a21ac` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:12.045199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d7b59f11d5451c87ce8e8d7b9a21ac)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:12.047221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:12.132374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d7b59f11d5451c87ce8e8d7b9a21ac', 'request_id': 'req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:12.138898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:12.143796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d7b59f11d5451c87ce8e8d7b9a21ac', 'request_id': 'req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:12.155222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d7b59f11d5451c87ce8e8d7b9a21ac', 'request_id': 'req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:12.179001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] The token cache is being invalidate because project d3d7b59f11d5451c87ce8e8d7b9a21ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:12.179485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:12.180359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5a4a9cc5-d2fd-4b7a-8628-83f75e5a879a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:12.183018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1053/2129] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:11 2022] DELETE /identity/v3/projects/d3d7b59f11d5451c87ce8e8d7b9a21ac => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:12.188744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a89b-53bb-4757-a8b3-2dcd7c010211 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:12.189218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a89b-53bb-4757-a8b3-2dcd7c010211 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:12.189589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a89b-53bb-4757-a8b3-2dcd7c010211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:12.210955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-0c76a89b-53bb-4757-a8b3-2dcd7c010211 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:12.212185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0c76a89b-53bb-4757-a8b3-2dcd7c010211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:12.300934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1077/2130] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:10:12.309473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126d7b-034e-4972-a3e0-7913cf0d0de6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:12.309572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126d7b-034e-4972-a3e0-7913cf0d0de6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:12.309909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126d7b-034e-4972-a3e0-7913cf0d0de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:12.341609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3c126d7b-034e-4972-a3e0-7913cf0d0de6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:12.343907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3c126d7b-034e-4972-a3e0-7913cf0d0de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:12.355465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1054/2131] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:12.360023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a89b-53bb-4757-a8b3-2dcd7c010211 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:12.371373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a89b-53bb-4757-a8b3-2dcd7c010211 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:12.386219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4d6e2-9e82-468b-b80a-57d84a9e2507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:12.386942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4d6e2-9e82-468b-b80a-57d84a9e2507 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:12.387257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4d6e2-9e82-468b-b80a-57d84a9e2507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:12.387554 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4d6e2-9e82-468b-b80a-57d84a9e2507 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:12.388365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4d6e2-9e82-468b-b80a-57d84a9e2507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:10:12.388754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4d6e2-9e82-468b-b80a-57d84a9e2507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:12.390814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4d6e2-9e82-468b-b80a-57d84a9e2507 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:12.409152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1078/2132] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:10:12.410359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c126d7b-034e-4972-a3e0-7913cf0d0de6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:12.423343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c126d7b-034e-4972-a3e0-7913cf0d0de6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:12.429381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bab3da-712d-4362-80f6-a0ccae49f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:12.430000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab3da-712d-4362-80f6-a0ccae49f670 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:12.430324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab3da-712d-4362-80f6-a0ccae49f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:12.430644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab3da-712d-4362-80f6-a0ccae49f670 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:12.431620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bab3da-712d-4362-80f6-a0ccae49f670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:12.433581 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bab3da-712d-4362-80f6-a0ccae49f670 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:12.471454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1055/2133] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:12 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:12.472734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4d6e2-9e82-468b-b80a-57d84a9e2507 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:12.484506 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4d6e2-9e82-468b-b80a-57d84a9e2507 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:12.565531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1f9c1-2756-4efc-ab2b-b2d7addac139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:12.566159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f9c1-2756-4efc-ab2b-b2d7addac139 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:12.566466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f9c1-2756-4efc-ab2b-b2d7addac139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:12.566965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f9c1-2756-4efc-ab2b-b2d7addac139 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:12.567449 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1f9c1-2756-4efc-ab2b-b2d7addac139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:12.569923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1f9c1-2756-4efc-ab2b-b2d7addac139 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:12.607445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bab3da-712d-4362-80f6-a0ccae49f670 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:12.608652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1079/2134] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:12 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:10:12.629697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bab3da-712d-4362-80f6-a0ccae49f670 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:12.641676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0d56a-c2bf-44b5-88f9-e374f1f4906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:12.642355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0d56a-c2bf-44b5-88f9-e374f1f4906e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:12.642666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0d56a-c2bf-44b5-88f9-e374f1f4906e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:12.642936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0d56a-c2bf-44b5-88f9-e374f1f4906e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:12.643693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0d56a-c2bf-44b5-88f9-e374f1f4906e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:12.645983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0d56a-c2bf-44b5-88f9-e374f1f4906e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:12.659376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1056/2135] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:12.663113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1f9c1-2756-4efc-ab2b-b2d7addac139 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:12.677001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1f9c1-2756-4efc-ab2b-b2d7addac139 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:12.687519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6246988-773d-4de2-ae10-1e843e4f96a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:12.688617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6246988-773d-4de2-ae10-1e843e4f96a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:12.689545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6246988-773d-4de2-ae10-1e843e4f96a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:12.690997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6246988-773d-4de2-ae10-1e843e4f96a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:12.691788 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6246988-773d-4de2-ae10-1e843e4f96a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:12.695461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6246988-773d-4de2-ae10-1e843e4f96a7 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:12.724771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1080/2136] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:10:12.729115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0d56a-c2bf-44b5-88f9-e374f1f4906e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:12.744536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0d56a-c2bf-44b5-88f9-e374f1f4906e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:12.759238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51b936-04cc-4ea5-9bfd-b4b67a35a486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:12.759922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51b936-04cc-4ea5-9bfd-b4b67a35a486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:12.760205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51b936-04cc-4ea5-9bfd-b4b67a35a486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:12.764442 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51b936-04cc-4ea5-9bfd-b4b67a35a486 admin admin] PATH_INFO: `/v3/projects/28a1dc6fe7354c638875f97d0b3210ea/users/f5a7f4da20954e6e87f8431db68baa1d/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:12.797090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51b936-04cc-4ea5-9bfd-b4b67a35a486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a1dc6fe7354c638875f97d0b3210ea, user_id=f5a7f4da20954e6e87f8431db68baa1d, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:12.805821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51b936-04cc-4ea5-9bfd-b4b67a35a486 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:12.841212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1057/2137] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:12 2022] PUT /identity/v3/projects/28a1dc6fe7354c638875f97d0b3210ea/users/f5a7f4da20954e6e87f8431db68baa1d/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:12.852392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d42ba-f3a4-48f6-bbb1-fcdab5a1f258 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:12.852914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d42ba-f3a4-48f6-bbb1-fcdab5a1f258 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:12.853339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d42ba-f3a4-48f6-bbb1-fcdab5a1f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:12.915834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e33d42ba-f3a4-48f6-bbb1-fcdab5a1f258 None None] MFA Rules not processed for user `f5a7f4da20954e6e87f8431db68baa1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:12.917084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e33d42ba-f3a4-48f6-bbb1-fcdab5a1f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:12.941301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:13.082266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1081/2138] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:13.094821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51b936-04cc-4ea5-9bfd-b4b67a35a486 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:13.098624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1a51b936-04cc-4ea5-9bfd-b4b67a35a486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:13.291626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51b936-04cc-4ea5-9bfd-b4b67a35a486 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:13.297687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11849e55-987e-404f-a140-9630d83f57e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:13.298328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11849e55-987e-404f-a140-9630d83f57e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:13.298709 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11849e55-987e-404f-a140-9630d83f57e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:13.298961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11849e55-987e-404f-a140-9630d83f57e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:13.309971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11849e55-987e-404f-a140-9630d83f57e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:13.312082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11849e55-987e-404f-a140-9630d83f57e8 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:13.324753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1058/2139] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:14.890345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d42ba-f3a4-48f6-bbb1-fcdab5a1f258 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:14.893303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e33d42ba-f3a4-48f6-bbb1-fcdab5a1f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:14.982742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d42ba-f3a4-48f6-bbb1-fcdab5a1f258 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:14.987227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:14.987867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:14.988144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:14.989481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] PATH_INFO: `/v3/users/b7d7625bb151490a91ac389021a2e0c7` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:14.991426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d7625bb151490a91ac389021a2e0c7)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:14.993328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:15.041658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d7625bb151490a91ac389021a2e0c7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:15.042751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d7625bb151490a91ac389021a2e0c7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:15.050177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d7625bb151490a91ac389021a2e0c7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:15.065135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d7625bb151490a91ac389021a2e0c7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:15.065798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c8f38466-f004-43ad-9201-5a6448b43a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d7625bb151490a91ac389021a2e0c7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:15.080393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1082/2140] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:14 2022] DELETE /identity/v3/users/b7d7625bb151490a91ac389021a2e0c7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:15.322520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11849e55-987e-404f-a140-9630d83f57e8 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:15.335405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11849e55-987e-404f-a140-9630d83f57e8 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:15.393397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:15.394041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:15.394324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:15.394635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] PATH_INFO: `/v3/projects/5b2e4ed4c5d0455c996be0b7208d6590` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:15.395795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2e4ed4c5d0455c996be0b7208d6590)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:15.397743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:15.421541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:15.449213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2e4ed4c5d0455c996be0b7208d6590', 'request_id': 'req-73257a01-6c4a-4490-b353-58605be060b4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:15.454726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2e4ed4c5d0455c996be0b7208d6590', 'request_id': 'req-73257a01-6c4a-4490-b353-58605be060b4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:15.460872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2e4ed4c5d0455c996be0b7208d6590', 'request_id': 'req-73257a01-6c4a-4490-b353-58605be060b4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:15.473865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] The token cache is being invalidate because project 5b2e4ed4c5d0455c996be0b7208d6590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:15.474191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:15.475847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73257a01-6c4a-4490-b353-58605be060b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:15.477855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1059/2141] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:15 2022] DELETE /identity/v3/projects/5b2e4ed4c5d0455c996be0b7208d6590 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:15.484822 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec9177-a91b-4c94-8a91-ed4dea735782 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:15.485087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec9177-a91b-4c94-8a91-ed4dea735782 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:15.485419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec9177-a91b-4c94-8a91-ed4dea735782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:15.506109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a3ec9177-a91b-4c94-8a91-ed4dea735782 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:15.507328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a3ec9177-a91b-4c94-8a91-ed4dea735782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:15.527006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:15.582692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1083/2142] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:15.585574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7486c-b2ae-4ef6-b608-ffc963263dce None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:15.585876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7486c-b2ae-4ef6-b608-ffc963263dce None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:15.586131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7486c-b2ae-4ef6-b608-ffc963263dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:15.606797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-98d7486c-b2ae-4ef6-b608-ffc963263dce None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:15.608103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-98d7486c-b2ae-4ef6-b608-ffc963263dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:15.616974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1060/2143] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:15.621529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec9177-a91b-4c94-8a91-ed4dea735782 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:15.632162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec9177-a91b-4c94-8a91-ed4dea735782 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:15.637845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea732b-c631-4247-af34-7fa61fdc703d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:15.639021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea732b-c631-4247-af34-7fa61fdc703d admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:15.639021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea732b-c631-4247-af34-7fa61fdc703d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:15.639184 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea732b-c631-4247-af34-7fa61fdc703d admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:15.639763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea732b-c631-4247-af34-7fa61fdc703d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:10:15.640067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea732b-c631-4247-af34-7fa61fdc703d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:15.641681 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea732b-c631-4247-af34-7fa61fdc703d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:15.654579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1084/2144] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:10:15.658891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7486c-b2ae-4ef6-b608-ffc963263dce None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:15.671600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7486c-b2ae-4ef6-b608-ffc963263dce None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:15.679958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd929f3-c2d9-45ac-be95-f9f1230e06f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:15.680585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd929f3-c2d9-45ac-be95-f9f1230e06f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:15.680869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd929f3-c2d9-45ac-be95-f9f1230e06f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:15.681145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd929f3-c2d9-45ac-be95-f9f1230e06f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:15.681815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd929f3-c2d9-45ac-be95-f9f1230e06f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:15.683754 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd929f3-c2d9-45ac-be95-f9f1230e06f2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:15.713609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1061/2145] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:15 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:15.716436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea732b-c631-4247-af34-7fa61fdc703d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:15.730104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea732b-c631-4247-af34-7fa61fdc703d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:15.797113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901b736-94b1-41c6-b9c6-b5381138676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:15.797737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901b736-94b1-41c6-b9c6-b5381138676d admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:15.798022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901b736-94b1-41c6-b9c6-b5381138676d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:15.798301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901b736-94b1-41c6-b9c6-b5381138676d admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:15.799016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901b736-94b1-41c6-b9c6-b5381138676d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:15.800988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901b736-94b1-41c6-b9c6-b5381138676d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:15.824793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1085/2146] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:15 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:15.828746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd929f3-c2d9-45ac-be95-f9f1230e06f2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:15.839593 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd929f3-c2d9-45ac-be95-f9f1230e06f2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:15.844486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fb350-1a41-4ea7-afbd-d372bf9f008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:15.845163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fb350-1a41-4ea7-afbd-d372bf9f008c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:15.845449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fb350-1a41-4ea7-afbd-d372bf9f008c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:15.845724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fb350-1a41-4ea7-afbd-d372bf9f008c admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:15.846427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fb350-1a41-4ea7-afbd-d372bf9f008c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:15.848120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fb350-1a41-4ea7-afbd-d372bf9f008c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:15.859967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1062/2147] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:10:15.869888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901b736-94b1-41c6-b9c6-b5381138676d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:15.881176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901b736-94b1-41c6-b9c6-b5381138676d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:15.885876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c60615-16e0-4d65-9d56-cae044b3ae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:15.886546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60615-16e0-4d65-9d56-cae044b3ae76 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:15.886829 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60615-16e0-4d65-9d56-cae044b3ae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:15.887156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60615-16e0-4d65-9d56-cae044b3ae76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:15.887789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c60615-16e0-4d65-9d56-cae044b3ae76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:15.889581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c60615-16e0-4d65-9d56-cae044b3ae76 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:15.901602 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1086/2148] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:15.905582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fb350-1a41-4ea7-afbd-d372bf9f008c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:15.916144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fb350-1a41-4ea7-afbd-d372bf9f008c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:15.921383 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02c239-ba49-45ee-8cf6-4654f318a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:15.922008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02c239-ba49-45ee-8cf6-4654f318a8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:15.922285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02c239-ba49-45ee-8cf6-4654f318a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:15.922598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02c239-ba49-45ee-8cf6-4654f318a8f7 admin admin] PATH_INFO: `/v3/projects/b926dc3ac60a4162b0b74ff58cb4c010/users/e764d33d7082482ab25c7022f1d94d6c/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:15.939066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02c239-ba49-45ee-8cf6-4654f318a8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b926dc3ac60a4162b0b74ff58cb4c010, user_id=e764d33d7082482ab25c7022f1d94d6c, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:15.941998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02c239-ba49-45ee-8cf6-4654f318a8f7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:15.956049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1063/2149] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:15 2022] PUT /identity/v3/projects/b926dc3ac60a4162b0b74ff58cb4c010/users/e764d33d7082482ab25c7022f1d94d6c/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:15.966397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762bc9-cf3d-45d1-ae3e-b29260c8090d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:15.967258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762bc9-cf3d-45d1-ae3e-b29260c8090d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:15.967258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762bc9-cf3d-45d1-ae3e-b29260c8090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:15.997530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-b0762bc9-cf3d-45d1-ae3e-b29260c8090d None None] MFA Rules not processed for user `e764d33d7082482ab25c7022f1d94d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:15.998790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b0762bc9-cf3d-45d1-ae3e-b29260c8090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:16.043088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02c239-ba49-45ee-8cf6-4654f318a8f7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:16.044938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7b02c239-ba49-45ee-8cf6-4654f318a8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:16.082032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1087/2150] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:16.083116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0762bc9-cf3d-45d1-ae3e-b29260c8090d None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:16.109055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:16.130653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02c239-ba49-45ee-8cf6-4654f318a8f7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:16.136330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:16.137196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:16.137546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:16.137886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] PATH_INFO: `/v3/users/f5a7f4da20954e6e87f8431db68baa1d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:16.139225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a7f4da20954e6e87f8431db68baa1d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:16.141272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:16.171652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0762bc9-cf3d-45d1-ae3e-b29260c8090d None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:16.177918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca93694-ab23-4f9e-86a4-4c9fd6a803ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:16.178583 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93694-ab23-4f9e-86a4-4c9fd6a803ea admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:16.179860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93694-ab23-4f9e-86a4-4c9fd6a803ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:16.180156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93694-ab23-4f9e-86a4-4c9fd6a803ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:16.180847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca93694-ab23-4f9e-86a4-4c9fd6a803ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:16.182925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca93694-ab23-4f9e-86a4-4c9fd6a803ea admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:16.207232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a7f4da20954e6e87f8431db68baa1d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:16.208521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a7f4da20954e6e87f8431db68baa1d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:16.211952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:16.218863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1088/2151] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:16 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:16.222404 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a7f4da20954e6e87f8431db68baa1d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:16.223316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca93694-ab23-4f9e-86a4-4c9fd6a803ea admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:16.239627 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a7f4da20954e6e87f8431db68baa1d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:16.240406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7ce5a554-d924-4814-8ff8-851a3592c9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a7f4da20954e6e87f8431db68baa1d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:16.271166 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1064/2152] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:16 2022] DELETE /identity/v3/users/f5a7f4da20954e6e87f8431db68baa1d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:10:16.273330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee74052-7681-4995-bd42-badeb3f67d62 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:16.273621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee74052-7681-4995-bd42-badeb3f67d62 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:16.273884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee74052-7681-4995-bd42-badeb3f67d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:16.307557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1ee74052-7681-4995-bd42-badeb3f67d62 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:16.309169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1ee74052-7681-4995-bd42-badeb3f67d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:16.319825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca93694-ab23-4f9e-86a4-4c9fd6a803ea admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:16.397109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1065/2153] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:16.407125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e0d7c-2cbd-4757-8542-c89ac58c8287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:16.407898 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e0d7c-2cbd-4757-8542-c89ac58c8287 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:16.408444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e0d7c-2cbd-4757-8542-c89ac58c8287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:16.408821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e0d7c-2cbd-4757-8542-c89ac58c8287 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:16.409219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee74052-7681-4995-bd42-badeb3f67d62 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:16.409828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e0d7c-2cbd-4757-8542-c89ac58c8287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:16.410888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1ee74052-7681-4995-bd42-badeb3f67d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:16.412283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e0d7c-2cbd-4757-8542-c89ac58c8287 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:16.442064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1089/2154] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:16 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:10:16.444046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e0d7c-2cbd-4757-8542-c89ac58c8287 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:16.446816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b41e0d7c-2cbd-4757-8542-c89ac58c8287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:16.462798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e0d7c-2cbd-4757-8542-c89ac58c8287 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:16.477897 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b54977-ef14-4272-af59-c3e7cabd7b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:16.478611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b54977-ef14-4272-af59-c3e7cabd7b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:16.478893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b54977-ef14-4272-af59-c3e7cabd7b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:16.479167 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b54977-ef14-4272-af59-c3e7cabd7b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:16.479882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b54977-ef14-4272-af59-c3e7cabd7b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:16.481514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b54977-ef14-4272-af59-c3e7cabd7b32 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:16.496187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1090/2155] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:10:16.497876 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b54977-ef14-4272-af59-c3e7cabd7b32 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:16.499921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee74052-7681-4995-bd42-badeb3f67d62 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:16.505156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74174b-c084-4ca7-a248-351912a74cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:16.506549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74174b-c084-4ca7-a248-351912a74cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:16.506901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74174b-c084-4ca7-a248-351912a74cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:16.507250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74174b-c084-4ca7-a248-351912a74cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:16.511810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b54977-ef14-4272-af59-c3e7cabd7b32 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:16.520416 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74174b-c084-4ca7-a248-351912a74cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:16.523168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74174b-c084-4ca7-a248-351912a74cc5 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:16.523310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655135e9-b224-4feb-9c44-70a9edf856c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:16.524040 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655135e9-b224-4feb-9c44-70a9edf856c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:16.524321 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655135e9-b224-4feb-9c44-70a9edf856c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:16.524706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655135e9-b224-4feb-9c44-70a9edf856c4 admin admin] PATH_INFO: `/v3/projects/065f62ed001547ba94a70bee0e142c3f/users/d35f8db2e6f2407390e9748826219ad6/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:16.543709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655135e9-b224-4feb-9c44-70a9edf856c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065f62ed001547ba94a70bee0e142c3f, user_id=d35f8db2e6f2407390e9748826219ad6, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:16.547225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655135e9-b224-4feb-9c44-70a9edf856c4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:16.554276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1066/2156] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:10:16.570175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1091/2157] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:16 2022] PUT /identity/v3/projects/065f62ed001547ba94a70bee0e142c3f/users/d35f8db2e6f2407390e9748826219ad6/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:16.570900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74174b-c084-4ca7-a248-351912a74cc5 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:16.582238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74174b-c084-4ca7-a248-351912a74cc5 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:16.687122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a680e-19c8-46dd-b475-157f5d957350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:16.687872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a680e-19c8-46dd-b475-157f5d957350 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:16.688278 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a680e-19c8-46dd-b475-157f5d957350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:16.688629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a680e-19c8-46dd-b475-157f5d957350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:16.689790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a680e-19c8-46dd-b475-157f5d957350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:16.691752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a680e-19c8-46dd-b475-157f5d957350 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:16.709376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1067/2158] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:10:16.713423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655135e9-b224-4feb-9c44-70a9edf856c4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:16.734875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655135e9-b224-4feb-9c44-70a9edf856c4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:16.745505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89909-d320-43f1-88f9-92fd95d1ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:16.746198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89909-d320-43f1-88f9-92fd95d1ec98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:16.746501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89909-d320-43f1-88f9-92fd95d1ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:16.746785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89909-d320-43f1-88f9-92fd95d1ec98 admin admin] PATH_INFO: `/v3/projects/065f62ed001547ba94a70bee0e142c3f/users/d35f8db2e6f2407390e9748826219ad6/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:16.750908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a89909-d320-43f1-88f9-92fd95d1ec98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065f62ed001547ba94a70bee0e142c3f, user_id=d35f8db2e6f2407390e9748826219ad6, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:16.753858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a89909-d320-43f1-88f9-92fd95d1ec98 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:16.763847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:16.798122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1092/2159] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:16 2022] PUT /identity/v3/projects/065f62ed001547ba94a70bee0e142c3f/users/d35f8db2e6f2407390e9748826219ad6/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:10:16.810284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe0bf-92db-48fe-b6be-21ca443b00c2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:16.811253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe0bf-92db-48fe-b6be-21ca443b00c2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:16.811527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe0bf-92db-48fe-b6be-21ca443b00c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:16.829798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:16.852888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6cffe0bf-92db-48fe-b6be-21ca443b00c2 None None] MFA Rules not processed for user `d35f8db2e6f2407390e9748826219ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:16.854285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6cffe0bf-92db-48fe-b6be-21ca443b00c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:16.954767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1068/2160] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:16.967935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89909-d320-43f1-88f9-92fd95d1ec98 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:16.969740 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-48a89909-d320-43f1-88f9-92fd95d1ec98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:16.971645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffe0bf-92db-48fe-b6be-21ca443b00c2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:16.973444 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6cffe0bf-92db-48fe-b6be-21ca443b00c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:17.049661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89909-d320-43f1-88f9-92fd95d1ec98 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:17.057003 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:17.057652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.057933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.058211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] PATH_INFO: `/v3/projects/28a1dc6fe7354c638875f97d0b3210ea` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.059438 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a1dc6fe7354c638875f97d0b3210ea)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:17.061540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:17.080241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffe0bf-92db-48fe-b6be-21ca443b00c2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:17.084412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e24aab-44d5-4ca3-beb4-b726d698125f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:17.084984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e24aab-44d5-4ca3-beb4-b726d698125f service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.085264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e24aab-44d5-4ca3-beb4-b726d698125f service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.085536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e24aab-44d5-4ca3-beb4-b726d698125f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.104505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e24aab-44d5-4ca3-beb4-b726d698125f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:17.105982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e24aab-44d5-4ca3-beb4-b726d698125f service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:17.124041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1069/2161] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:17.163430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a1dc6fe7354c638875f97d0b3210ea', 'request_id': 'req-190a77f9-0211-4fa4-aec4-eb652b84cf99'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:17.172929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a1dc6fe7354c638875f97d0b3210ea', 'request_id': 'req-190a77f9-0211-4fa4-aec4-eb652b84cf99'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:17.182159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a1dc6fe7354c638875f97d0b3210ea', 'request_id': 'req-190a77f9-0211-4fa4-aec4-eb652b84cf99'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:17.195227 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e24aab-44d5-4ca3-beb4-b726d698125f service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:17.197692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] The token cache is being invalidate because project 28a1dc6fe7354c638875f97d0b3210ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:17.197989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:17.198704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-190a77f9-0211-4fa4-aec4-eb652b84cf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:17.204887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1093/2162] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:16 2022] DELETE /identity/v3/projects/28a1dc6fe7354c638875f97d0b3210ea => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:17.206143 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e2a83-8f5d-46c7-9dc5-1258e542a49f None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.206450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e2a83-8f5d-46c7-9dc5-1258e542a49f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.206735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e2a83-8f5d-46c7-9dc5-1258e542a49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.211533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e24aab-44d5-4ca3-beb4-b726d698125f service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:17.229712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-057e2a83-8f5d-46c7-9dc5-1258e542a49f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:17.231256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-057e2a83-8f5d-46c7-9dc5-1258e542a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:17.314592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1094/2163] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:17.394128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:17.395264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.395264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.395635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] PATH_INFO: `/v3/users/e764d33d7082482ab25c7022f1d94d6c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.397555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e764d33d7082482ab25c7022f1d94d6c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:17.399645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:17.407978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201d40e-3649-4d39-8b07-2a0bc8319924 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.412505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201d40e-3649-4d39-8b07-2a0bc8319924 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.416668 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201d40e-3649-4d39-8b07-2a0bc8319924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.450908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d201d40e-3649-4d39-8b07-2a0bc8319924 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:17.452232 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d201d40e-3649-4d39-8b07-2a0bc8319924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:17.471450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1095/2164] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:17.479590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:17.486254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201d40e-3649-4d39-8b07-2a0bc8319924 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:17.494875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e764d33d7082482ab25c7022f1d94d6c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:17.496095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e764d33d7082482ab25c7022f1d94d6c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:17.507607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e764d33d7082482ab25c7022f1d94d6c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:17.515269 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201d40e-3649-4d39-8b07-2a0bc8319924 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:17.529174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e764d33d7082482ab25c7022f1d94d6c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:17.530771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2ebe9b72-de38-415e-8694-b9e04d8cf2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e764d33d7082482ab25c7022f1d94d6c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:17.531124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dc3e1-b88e-4ec4-aefe-8b53ec30ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:17.532002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dc3e1-b88e-4ec4-aefe-8b53ec30ae66 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.532352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dc3e1-b88e-4ec4-aefe-8b53ec30ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.532784 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dc3e1-b88e-4ec4-aefe-8b53ec30ae66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.533708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dc3e1-b88e-4ec4-aefe-8b53ec30ae66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:10:17.533997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dc3e1-b88e-4ec4-aefe-8b53ec30ae66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:17.539088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dc3e1-b88e-4ec4-aefe-8b53ec30ae66 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:17.557249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1070/2165] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:17 2022] DELETE /identity/v3/users/e764d33d7082482ab25c7022f1d94d6c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:17.562477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3efda-e9a7-4922-99c6-f152821f47c2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.563534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3efda-e9a7-4922-99c6-f152821f47c2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.564037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3efda-e9a7-4922-99c6-f152821f47c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.576016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1096/2166] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:10:17.576888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dc3e1-b88e-4ec4-aefe-8b53ec30ae66 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:17.579504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d03dc3e1-b88e-4ec4-aefe-8b53ec30ae66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:17.590885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:17.591844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d6e3efda-e9a7-4922-99c6-f152821f47c2 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:17.593535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d6e3efda-e9a7-4922-99c6-f152821f47c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:17.600810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dc3e1-b88e-4ec4-aefe-8b53ec30ae66 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:17.701489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e11fb-da6c-454d-9fe3-deb32d4f6f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:17.702609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1071/2167] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:10:17.702775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e11fb-da6c-454d-9fe3-deb32d4f6f60 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.703121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e11fb-da6c-454d-9fe3-deb32d4f6f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.703407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e11fb-da6c-454d-9fe3-deb32d4f6f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.704145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e11fb-da6c-454d-9fe3-deb32d4f6f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:17.707350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e11fb-da6c-454d-9fe3-deb32d4f6f60 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:17.712175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3efda-e9a7-4922-99c6-f152821f47c2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:17.714467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d6e3efda-e9a7-4922-99c6-f152821f47c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:17.744948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1097/2168] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:17 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:17.745855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e11fb-da6c-454d-9fe3-deb32d4f6f60 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:17.801805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3efda-e9a7-4922-99c6-f152821f47c2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:17.846646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e11fb-da6c-454d-9fe3-deb32d4f6f60 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:17.853700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67690a36-00e1-4bde-befd-2cc7d05769f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:17.854412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690a36-00e1-4bde-befd-2cc7d05769f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.854824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690a36-00e1-4bde-befd-2cc7d05769f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.855281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690a36-00e1-4bde-befd-2cc7d05769f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.856245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67690a36-00e1-4bde-befd-2cc7d05769f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:17.859188 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67690a36-00e1-4bde-befd-2cc7d05769f2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:17.894039 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1098/2169] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:17 2022] POST /identity/v3/users => generated 282 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:17.894990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67690a36-00e1-4bde-befd-2cc7d05769f2 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:17.909560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67690a36-00e1-4bde-befd-2cc7d05769f2 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:17.919587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd3839-11a5-4b5c-9867-fd1a6890f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:17.920434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd3839-11a5-4b5c-9867-fd1a6890f9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.920915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd3839-11a5-4b5c-9867-fd1a6890f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.921267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd3839-11a5-4b5c-9867-fd1a6890f9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.922314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd3839-11a5-4b5c-9867-fd1a6890f9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:17.924948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd3839-11a5-4b5c-9867-fd1a6890f9b7 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:17.930172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4d647-516d-4cba-974e-10b635d8b9ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:17.930918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d647-516d-4cba-974e-10b635d8b9ea service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.931265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d647-516d-4cba-974e-10b635d8b9ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.931948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d647-516d-4cba-974e-10b635d8b9ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.944643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4d647-516d-4cba-974e-10b635d8b9ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:17.945391 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1099/2170] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:17.947330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4d647-516d-4cba-974e-10b635d8b9ea service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:17.950311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd3839-11a5-4b5c-9867-fd1a6890f9b7 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:17.963391 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd3839-11a5-4b5c-9867-fd1a6890f9b7 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:17.973250 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c4588-782b-4b5e-820a-2ba312ae0229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:17.976228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c4588-782b-4b5e-820a-2ba312ae0229 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:17.976228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c4588-782b-4b5e-820a-2ba312ae0229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:17.977974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c4588-782b-4b5e-820a-2ba312ae0229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:17.978850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c4588-782b-4b5e-820a-2ba312ae0229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:17.980214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1072/2171] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:10:17.982197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c4588-782b-4b5e-820a-2ba312ae0229 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:18.021525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1100/2172] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:18.022461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4d647-516d-4cba-974e-10b635d8b9ea service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:18.038072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4d647-516d-4cba-974e-10b635d8b9ea service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:18.043453 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371dc6b-804d-477a-9460-7fac576f7b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:18.044270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371dc6b-804d-477a-9460-7fac576f7b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:18.044613 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371dc6b-804d-477a-9460-7fac576f7b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:18.044952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371dc6b-804d-477a-9460-7fac576f7b0e admin admin] PATH_INFO: `/v3/projects/c783e533aa934e839235757bff619ea5/users/a7ac6b31657b46e69cdcba28221213e7/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:18.076813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:18.082599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371dc6b-804d-477a-9460-7fac576f7b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c783e533aa934e839235757bff619ea5, user_id=a7ac6b31657b46e69cdcba28221213e7, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:18.086970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371dc6b-804d-477a-9460-7fac576f7b0e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:18.119752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1073/2173] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:18 2022] PUT /identity/v3/projects/c783e533aa934e839235757bff619ea5/users/a7ac6b31657b46e69cdcba28221213e7/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:18.122949 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55ffb-b8c7-4cef-82a2-92b231b630bb None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:18.123298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55ffb-b8c7-4cef-82a2-92b231b630bb None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:18.123580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55ffb-b8c7-4cef-82a2-92b231b630bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:18.159507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-daf55ffb-b8c7-4cef-82a2-92b231b630bb None None] MFA Rules not processed for user `a7ac6b31657b46e69cdcba28221213e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:18.160921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-daf55ffb-b8c7-4cef-82a2-92b231b630bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:18.236871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:18.284657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1101/2174] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:18.298996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371dc6b-804d-477a-9460-7fac576f7b0e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:18.300869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9371dc6b-804d-477a-9460-7fac576f7b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:18.385597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371dc6b-804d-477a-9460-7fac576f7b0e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:18.390391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc27fb-a302-45eb-b9ff-70f8413a6163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:18.391156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc27fb-a302-45eb-b9ff-70f8413a6163 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:18.391636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc27fb-a302-45eb-b9ff-70f8413a6163 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:18.392009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc27fb-a302-45eb-b9ff-70f8413a6163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:18.402399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc27fb-a302-45eb-b9ff-70f8413a6163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:18.404138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc27fb-a302-45eb-b9ff-70f8413a6163 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:18.429441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1074/2175] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:18.455384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55ffb-b8c7-4cef-82a2-92b231b630bb None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:18.457376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-daf55ffb-b8c7-4cef-82a2-92b231b630bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:18.583592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55ffb-b8c7-4cef-82a2-92b231b630bb None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:18.588627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:18.589528 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:18.589908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:18.590286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] PATH_INFO: `/v3/projects/b926dc3ac60a4162b0b74ff58cb4c010` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:18.591754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b926dc3ac60a4162b0b74ff58cb4c010)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:18.593862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:18.660696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b926dc3ac60a4162b0b74ff58cb4c010', 'request_id': 'req-d0b7d953-4c32-41f3-8c1e-395e42a53550'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:18.672685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b926dc3ac60a4162b0b74ff58cb4c010', 'request_id': 'req-d0b7d953-4c32-41f3-8c1e-395e42a53550'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:18.685389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b926dc3ac60a4162b0b74ff58cb4c010', 'request_id': 'req-d0b7d953-4c32-41f3-8c1e-395e42a53550'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:18.701830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] The token cache is being invalidate because project b926dc3ac60a4162b0b74ff58cb4c010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:18.702192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:18.703027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0b7d953-4c32-41f3-8c1e-395e42a53550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:18.705534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1102/2176] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:18 2022] DELETE /identity/v3/projects/b926dc3ac60a4162b0b74ff58cb4c010 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:18.709535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc27fb-a302-45eb-b9ff-70f8413a6163 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:18.723851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc27fb-a302-45eb-b9ff-70f8413a6163 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:18.743293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea407-c05c-42c0-8e44-dd9d8ee94366 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:18.743750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea407-c05c-42c0-8e44-dd9d8ee94366 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:18.744047 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea407-c05c-42c0-8e44-dd9d8ee94366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:18.768937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a58ea407-c05c-42c0-8e44-dd9d8ee94366 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:18.770224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a58ea407-c05c-42c0-8e44-dd9d8ee94366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:18.801712 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:18.802417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:18.803361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:18.803641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] PATH_INFO: `/v3/users/d35f8db2e6f2407390e9748826219ad6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:18.805682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35f8db2e6f2407390e9748826219ad6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:18.808297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:18.862479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1103/2177] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:10:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:10:18.902430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35f8db2e6f2407390e9748826219ad6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:18.905921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35f8db2e6f2407390e9748826219ad6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:18.927523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35f8db2e6f2407390e9748826219ad6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:18.930329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ea407-c05c-42c0-8e44-dd9d8ee94366 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:18.931923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a58ea407-c05c-42c0-8e44-dd9d8ee94366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:18.946845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35f8db2e6f2407390e9748826219ad6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:18.947569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35f8db2e6f2407390e9748826219ad6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:18.974147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1075/2178] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:18 2022] DELETE /identity/v3/users/d35f8db2e6f2407390e9748826219ad6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:18.978308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:19.033573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ea407-c05c-42c0-8e44-dd9d8ee94366 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:19.102659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024285a-73cb-4336-8221-4db0013fd3da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:19.104349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024285a-73cb-4336-8221-4db0013fd3da service swift] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:19.104736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024285a-73cb-4336-8221-4db0013fd3da service swift] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:19.105122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024285a-73cb-4336-8221-4db0013fd3da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:19.107227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4024285a-73cb-4336-8221-4db0013fd3da service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:19.177290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024285a-73cb-4336-8221-4db0013fd3da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:19.179049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024285a-73cb-4336-8221-4db0013fd3da service swift] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:19.187840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1104/2179] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:10:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:10:19.400047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:19.402055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:19.420915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:19.509994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb445f46-541c-4c9f-b5fd-050b3651e716 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:19.517623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:19.519061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:19.519351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:19.520371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] PATH_INFO: `/v3/projects/065f62ed001547ba94a70bee0e142c3f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:19.522901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=065f62ed001547ba94a70bee0e142c3f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:19.538933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:19.596762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065f62ed001547ba94a70bee0e142c3f', 'request_id': 'req-8e5c8227-fcf8-460d-affb-3bb956d012cf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:19.603245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065f62ed001547ba94a70bee0e142c3f', 'request_id': 'req-8e5c8227-fcf8-460d-affb-3bb956d012cf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:19.610233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065f62ed001547ba94a70bee0e142c3f', 'request_id': 'req-8e5c8227-fcf8-460d-affb-3bb956d012cf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:19.628072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] The token cache is being invalidate because project 065f62ed001547ba94a70bee0e142c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:19.628371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:19.628980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-8e5c8227-fcf8-460d-affb-3bb956d012cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:19.631136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1076/2180] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:19 2022] DELETE /identity/v3/projects/065f62ed001547ba94a70bee0e142c3f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:19.636749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488f1c-8e67-40e9-9bdb-fdca865f5c45 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:19.637099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488f1c-8e67-40e9-9bdb-fdca865f5c45 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:19.637394 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488f1c-8e67-40e9-9bdb-fdca865f5c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:19.661557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-0d488f1c-8e67-40e9-9bdb-fdca865f5c45 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:19.662842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0d488f1c-8e67-40e9-9bdb-fdca865f5c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:19.730803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1105/2181] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:19.738264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069448-3d2f-4e04-a06b-009a1cb8b5fe None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:19.738627 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069448-3d2f-4e04-a06b-009a1cb8b5fe None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:19.738908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069448-3d2f-4e04-a06b-009a1cb8b5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:19.760451 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-96069448-3d2f-4e04-a06b-009a1cb8b5fe None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:19.761652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-96069448-3d2f-4e04-a06b-009a1cb8b5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:19.769817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1077/2182] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:19.773899 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488f1c-8e67-40e9-9bdb-fdca865f5c45 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:19.784459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488f1c-8e67-40e9-9bdb-fdca865f5c45 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:19.789508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f0c70-5aea-4efa-81b2-55b075a7cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:19.790134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0c70-5aea-4efa-81b2-55b075a7cf84 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:19.790417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0c70-5aea-4efa-81b2-55b075a7cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:19.790722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0c70-5aea-4efa-81b2-55b075a7cf84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:19.791514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0c70-5aea-4efa-81b2-55b075a7cf84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:10:19.791894 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0c70-5aea-4efa-81b2-55b075a7cf84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:19.793612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0c70-5aea-4efa-81b2-55b075a7cf84 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:19.795345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:19.807342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1106/2183] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:10:19.811440 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069448-3d2f-4e04-a06b-009a1cb8b5fe None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:19.821949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069448-3d2f-4e04-a06b-009a1cb8b5fe None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:19.823068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136ff2a-9645-4fdd-b7db-44733e2c8ede None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:19.823068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136ff2a-9645-4fdd-b7db-44733e2c8ede None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:19.823303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136ff2a-9645-4fdd-b7db-44733e2c8ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:19.827320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae32cd-8066-4922-b4c0-5bd5659e1a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:19.828075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae32cd-8066-4922-b4c0-5bd5659e1a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:19.828991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae32cd-8066-4922-b4c0-5bd5659e1a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:19.829270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae32cd-8066-4922-b4c0-5bd5659e1a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:19.830046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae32cd-8066-4922-b4c0-5bd5659e1a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:19.832725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae32cd-8066-4922-b4c0-5bd5659e1a46 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:19.843111 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4136ff2a-9645-4fdd-b7db-44733e2c8ede None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:19.844235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4136ff2a-9645-4fdd-b7db-44733e2c8ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:19.862524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1078/2184] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:19 2022] POST /identity/v3/projects => generated 409 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:19.864237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae32cd-8066-4922-b4c0-5bd5659e1a46 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:19.904967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1107/2185] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jul 28 02:10:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:10:19.918268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136ff2a-9645-4fdd-b7db-44733e2c8ede None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:19.919883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4136ff2a-9645-4fdd-b7db-44733e2c8ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:19.932561 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae32cd-8066-4922-b4c0-5bd5659e1a46 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:19.937266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbc4fc-194a-48b7-a749-9d4d99860c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:19.938579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc4fc-194a-48b7-a749-9d4d99860c20 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:19.938724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc4fc-194a-48b7-a749-9d4d99860c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:19.938909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc4fc-194a-48b7-a749-9d4d99860c20 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:19.939835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbc4fc-194a-48b7-a749-9d4d99860c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:19.941772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbc4fc-194a-48b7-a749-9d4d99860c20 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:19.967138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1079/2186] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:19 2022] POST /identity/v3/users => generated 305 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:10:19.971799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbc4fc-194a-48b7-a749-9d4d99860c20 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:19.976912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:19.984748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbc4fc-194a-48b7-a749-9d4d99860c20 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:19.993589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e662d-8ffd-477d-82f4-57c336a8483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:19.994206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e662d-8ffd-477d-82f4-57c336a8483b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:19.994511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e662d-8ffd-477d-82f4-57c336a8483b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:19.994784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e662d-8ffd-477d-82f4-57c336a8483b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:19.995476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e662d-8ffd-477d-82f4-57c336a8483b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:19.997199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e662d-8ffd-477d-82f4-57c336a8483b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.006071 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136ff2a-9645-4fdd-b7db-44733e2c8ede None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:20.010065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1080/2187] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:10:20.013997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e662d-8ffd-477d-82f4-57c336a8483b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:20.025363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e662d-8ffd-477d-82f4-57c336a8483b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:20.030267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674a75-9422-4e98-afab-474b083cbb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:20.030947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674a75-9422-4e98-afab-474b083cbb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.031231 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674a75-9422-4e98-afab-474b083cbb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.031502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674a75-9422-4e98-afab-474b083cbb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.032240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52674a75-9422-4e98-afab-474b083cbb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:20.033852 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52674a75-9422-4e98-afab-474b083cbb03 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.045349 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1081/2188] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:20.054903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674a75-9422-4e98-afab-474b083cbb03 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:20.066605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674a75-9422-4e98-afab-474b083cbb03 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:20.072292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d393934-3597-4302-9813-d6ecef16098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:20.072443 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6973b-e95e-4709-8316-8cf98f1b3bf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:20.072954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d393934-3597-4302-9813-d6ecef16098a admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.073148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6973b-e95e-4709-8316-8cf98f1b3bf5 service swift] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.073363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d393934-3597-4302-9813-d6ecef16098a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.073473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6973b-e95e-4709-8316-8cf98f1b3bf5 service swift] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.073637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d393934-3597-4302-9813-d6ecef16098a admin admin] PATH_INFO: `/v3/projects/f215a6341eeb4422b746ee8ab20a420a/users/13e9d9de0a6745be91c4f0a33eaa545e/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.073972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6973b-e95e-4709-8316-8cf98f1b3bf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.090990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d393934-3597-4302-9813-d6ecef16098a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f215a6341eeb4422b746ee8ab20a420a, user_id=13e9d9de0a6745be91c4f0a33eaa545e, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:20.094461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d393934-3597-4302-9813-d6ecef16098a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.110058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1082/2189] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:20 2022] PUT /identity/v3/projects/f215a6341eeb4422b746ee8ab20a420a/users/13e9d9de0a6745be91c4f0a33eaa545e/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:10:20.121818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40218d-46ca-48ec-8b96-ac3f22bfe123 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.122107 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40218d-46ca-48ec-8b96-ac3f22bfe123 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.122413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40218d-46ca-48ec-8b96-ac3f22bfe123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.130417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:20.148476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6973b-e95e-4709-8316-8cf98f1b3bf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:20.150078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6973b-e95e-4709-8316-8cf98f1b3bf5 service swift] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.159393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9c40218d-46ca-48ec-8b96-ac3f22bfe123 None None] MFA Rules not processed for user `13e9d9de0a6745be91c4f0a33eaa545e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:20.160769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9c40218d-46ca-48ec-8b96-ac3f22bfe123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:20.174710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1108/2190] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:10:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 02:10:20.258419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1083/2191] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:10:20.262908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6973b-e95e-4709-8316-8cf98f1b3bf5 service swift] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:20.278377 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6973b-e95e-4709-8316-8cf98f1b3bf5 service swift] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:20.405252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046ef34-4db2-4c23-a4d3-65a87263bccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:20.405896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046ef34-4db2-4c23-a4d3-65a87263bccc admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.406186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046ef34-4db2-4c23-a4d3-65a87263bccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.406500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046ef34-4db2-4c23-a4d3-65a87263bccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.407797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046ef34-4db2-4c23-a4d3-65a87263bccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:20.410349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046ef34-4db2-4c23-a4d3-65a87263bccc admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.450890 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1109/2192] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:20 2022] POST /identity/v3/projects => generated 409 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:20.454323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40218d-46ca-48ec-8b96-ac3f22bfe123 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:20.467126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40218d-46ca-48ec-8b96-ac3f22bfe123 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:20.509470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772e9b-0e3d-4d39-a569-dd2cea0b565e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.509961 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772e9b-0e3d-4d39-a569-dd2cea0b565e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.510225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772e9b-0e3d-4d39-a569-dd2cea0b565e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.537631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-08772e9b-0e3d-4d39-a569-dd2cea0b565e None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:20.539748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-08772e9b-0e3d-4d39-a569-dd2cea0b565e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:20.569048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737f4d9-094d-48e6-a7f3-459aec420c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:20.570396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737f4d9-094d-48e6-a7f3-459aec420c71 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.570723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737f4d9-094d-48e6-a7f3-459aec420c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.571004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737f4d9-094d-48e6-a7f3-459aec420c71 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.571689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737f4d9-094d-48e6-a7f3-459aec420c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:20.573619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737f4d9-094d-48e6-a7f3-459aec420c71 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.599033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1084/2193] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:20 2022] POST /identity/v3/users => generated 311 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:10:20.603778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737f4d9-094d-48e6-a7f3-459aec420c71 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:20.610771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1110/2194] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:10:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:20.616811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737f4d9-094d-48e6-a7f3-459aec420c71 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:20.621731 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846c6bc-c169-4314-952c-72487842795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:20.622454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846c6bc-c169-4314-952c-72487842795e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.622801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846c6bc-c169-4314-952c-72487842795e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.623197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846c6bc-c169-4314-952c-72487842795e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.623950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846c6bc-c169-4314-952c-72487842795e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:20.624593 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08772e9b-0e3d-4d39-a569-dd2cea0b565e None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:20.626535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846c6bc-c169-4314-952c-72487842795e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.639712 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1085/2195] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:20.644051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846c6bc-c169-4314-952c-72487842795e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:20.656470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846c6bc-c169-4314-952c-72487842795e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:20.663992 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a496eec-505c-476e-984a-be3701fb11a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:20.666002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a496eec-505c-476e-984a-be3701fb11a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.666298 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a496eec-505c-476e-984a-be3701fb11a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.666617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a496eec-505c-476e-984a-be3701fb11a6 admin admin] PATH_INFO: `/v3/projects/c52a30971cf140f088bce324bf16c004/users/f2f10f94476149549f8769b3cab725d0/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.684461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a496eec-505c-476e-984a-be3701fb11a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52a30971cf140f088bce324bf16c004, user_id=f2f10f94476149549f8769b3cab725d0, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:20.687315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a496eec-505c-476e-984a-be3701fb11a6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.714382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08772e9b-0e3d-4d39-a569-dd2cea0b565e None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:20.716331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:20.726228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6bc56-eabf-4554-8874-cfadca0b9c30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:20.726228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6bc56-eabf-4554-8874-cfadca0b9c30 service swift] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.726228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6bc56-eabf-4554-8874-cfadca0b9c30 service swift] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.726228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6bc56-eabf-4554-8874-cfadca0b9c30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.726556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1086/2196] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:20 2022] PUT /identity/v3/projects/c52a30971cf140f088bce324bf16c004/users/f2f10f94476149549f8769b3cab725d0/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:10:20.728846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a496eec-505c-476e-984a-be3701fb11a6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:20.741892 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6bc56-eabf-4554-8874-cfadca0b9c30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:20.746161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6bc56-eabf-4554-8874-cfadca0b9c30 service swift] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.765357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1111/2197] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:10:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 02:10:20.834199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a496eec-505c-476e-984a-be3701fb11a6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:20.841655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53b1fe-bedd-4ff2-9e1c-72edbf8dda42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:20.842552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b1fe-bedd-4ff2-9e1c-72edbf8dda42 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.842865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b1fe-bedd-4ff2-9e1c-72edbf8dda42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.843160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b1fe-bedd-4ff2-9e1c-72edbf8dda42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.843985 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53b1fe-bedd-4ff2-9e1c-72edbf8dda42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:20.846314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53b1fe-bedd-4ff2-9e1c-72edbf8dda42 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.862739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1087/2198] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:10:20.863354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6bc56-eabf-4554-8874-cfadca0b9c30 service swift] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:20.869996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:20.878301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6bc56-eabf-4554-8874-cfadca0b9c30 service swift] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:20.884702 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e67ad-a757-4bb0-8d7d-6bb600783dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:20.885443 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e67ad-a757-4bb0-8d7d-6bb600783dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.885811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e67ad-a757-4bb0-8d7d-6bb600783dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.886159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e67ad-a757-4bb0-8d7d-6bb600783dc4 admin admin] PATH_INFO: `/v3/projects/c52a30971cf140f088bce324bf16c004/users/f2f10f94476149549f8769b3cab725d0/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.888430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e67ad-a757-4bb0-8d7d-6bb600783dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52a30971cf140f088bce324bf16c004, user_id=f2f10f94476149549f8769b3cab725d0, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:20.891191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e67ad-a757-4bb0-8d7d-6bb600783dc4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:20.904594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1112/2199] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:20 2022] PUT /identity/v3/projects/c52a30971cf140f088bce324bf16c004/users/f2f10f94476149549f8769b3cab725d0/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:20.916907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c522d6-4307-46df-ba63-9d3b6306e78d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:20.917105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c522d6-4307-46df-ba63-9d3b6306e78d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:20.917541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c522d6-4307-46df-ba63-9d3b6306e78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:20.950772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-64c522d6-4307-46df-ba63-9d3b6306e78d None None] MFA Rules not processed for user `f2f10f94476149549f8769b3cab725d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:20.952184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-64c522d6-4307-46df-ba63-9d3b6306e78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:21.026472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1088/2200] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:20 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:10:21.037896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e67ad-a757-4bb0-8d7d-6bb600783dc4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:21.039721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b46e67ad-a757-4bb0-8d7d-6bb600783dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:21.103762 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e67ad-a757-4bb0-8d7d-6bb600783dc4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:21.107814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4246-9b28-4d8d-b08b-4acf7568eac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:21.108433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4246-9b28-4d8d-b08b-4acf7568eac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:21.108728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4246-9b28-4d8d-b08b-4acf7568eac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:21.109001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4246-9b28-4d8d-b08b-4acf7568eac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:21.118640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a4246-9b28-4d8d-b08b-4acf7568eac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:21.120088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a4246-9b28-4d8d-b08b-4acf7568eac5 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:21.129790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1113/2201] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:21.186912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5f28e-d73d-4363-bd4c-1a9be59e3a42 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:21.187206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5f28e-d73d-4363-bd4c-1a9be59e3a42 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:21.187526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5f28e-d73d-4363-bd4c-1a9be59e3a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:21.207320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-39e5f28e-d73d-4363-bd4c-1a9be59e3a42 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:21.208526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-39e5f28e-d73d-4363-bd4c-1a9be59e3a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:21.274068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1089/2202] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jul 28 02:10:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:21.290931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4246-9b28-4d8d-b08b-4acf7568eac5 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:21.291113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5f28e-d73d-4363-bd4c-1a9be59e3a42 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:21.298001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4246-9b28-4d8d-b08b-4acf7568eac5 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:21.302862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae0d3c-c950-403e-87bb-140c2c978657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:21.303863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae0d3c-c950-403e-87bb-140c2c978657 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:21.304149 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae0d3c-c950-403e-87bb-140c2c978657 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:21.304425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae0d3c-c950-403e-87bb-140c2c978657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:21.324433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:21.366747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae0d3c-c950-403e-87bb-140c2c978657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:21.366939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5f28e-d73d-4363-bd4c-1a9be59e3a42 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:21.368113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae0d3c-c950-403e-87bb-140c2c978657 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:21.371812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835ab8d-8988-4c62-851c-7fa3b0dd8147 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:21.372457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ab8d-8988-4c62-851c-7fa3b0dd8147 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:21.372742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ab8d-8988-4c62-851c-7fa3b0dd8147 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:21.373048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ab8d-8988-4c62-851c-7fa3b0dd8147 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:21.377557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1114/2203] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:21.381517 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835ab8d-8988-4c62-851c-7fa3b0dd8147 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:21.383158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835ab8d-8988-4c62-851c-7fa3b0dd8147 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:21.391865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1090/2204] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:10:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 02:10:23.662639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae0d3c-c950-403e-87bb-140c2c978657 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:23.665033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-eeae0d3c-c950-403e-87bb-140c2c978657 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:23.734353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae0d3c-c950-403e-87bb-140c2c978657 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:23.738922 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:23.739539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:23.740415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:23.740698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] PATH_INFO: `/v3/users/fa7132650cb24a23a6c17b726734ec11` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:23.741977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7132650cb24a23a6c17b726734ec11)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:23.744150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:23.777998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:23.791896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7132650cb24a23a6c17b726734ec11'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:23.792573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7132650cb24a23a6c17b726734ec11'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:23.800091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7132650cb24a23a6c17b726734ec11'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:23.814764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7132650cb24a23a6c17b726734ec11'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:23.815595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7132650cb24a23a6c17b726734ec11'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:23.828007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1115/2205] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:23 2022] DELETE /identity/v3/users/fa7132650cb24a23a6c17b726734ec11 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:23.832562 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c38b1-2443-4403-ac0a-1ee49d0508c4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:23.833023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c38b1-2443-4403-ac0a-1ee49d0508c4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:23.833114 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c38b1-2443-4403-ac0a-1ee49d0508c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:23.854288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1a9c38b1-2443-4403-ac0a-1ee49d0508c4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:23.855515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1a9c38b1-2443-4403-ac0a-1ee49d0508c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:23.918696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1091/2206] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:23.931869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:23.933306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:24.001737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72749bb3-be81-4365-b835-29c28d4c563e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:24.006125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff4cdb-df32-48bc-b50e-59d3483f4a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:24.006977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff4cdb-df32-48bc-b50e-59d3483f4a09 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.007259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff4cdb-df32-48bc-b50e-59d3483f4a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.007531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff4cdb-df32-48bc-b50e-59d3483f4a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.020958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff4cdb-df32-48bc-b50e-59d3483f4a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:24.022613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff4cdb-df32-48bc-b50e-59d3483f4a09 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:24.038355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1116/2207] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:10:24.228580 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c38b1-2443-4403-ac0a-1ee49d0508c4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:24.230258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1a9c38b1-2443-4403-ac0a-1ee49d0508c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:24.246859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c38b1-2443-4403-ac0a-1ee49d0508c4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:24.254546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff4cdb-df32-48bc-b50e-59d3483f4a09 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:24.256086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f0ff4cdb-df32-48bc-b50e-59d3483f4a09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:24.269077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:24.270014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.270741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.272080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] PATH_INFO: `/v3/projects/b323607668d7461ea435faac291e9fca` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.273506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b323607668d7461ea435faac291e9fca)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:24.275786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:24.277433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff4cdb-df32-48bc-b50e-59d3483f4a09 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:24.283245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:24.283877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.284174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.284460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] PATH_INFO: `/v3/users/87fc1c400ceb4424848bc3f57625f85d` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.285726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87fc1c400ceb4424848bc3f57625f85d)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:24.288322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:24.349840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b323607668d7461ea435faac291e9fca', 'request_id': 'req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:24.354410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87fc1c400ceb4424848bc3f57625f85d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:24.355131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87fc1c400ceb4424848bc3f57625f85d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:24.362038 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b323607668d7461ea435faac291e9fca', 'request_id': 'req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:24.364287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87fc1c400ceb4424848bc3f57625f85d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:24.372194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b323607668d7461ea435faac291e9fca', 'request_id': 'req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:24.384410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87fc1c400ceb4424848bc3f57625f85d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:24.385476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c6779417-fda7-461f-8873-2ab727bd0973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87fc1c400ceb4424848bc3f57625f85d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:24.399559 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] The token cache is being invalidate because project b323607668d7461ea435faac291e9fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:24.400446 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:24.401161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5bf71a76-c4dd-4a2b-a053-2dc9a0161723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:24.403688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1092/2208] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:24 2022] DELETE /identity/v3/projects/b323607668d7461ea435faac291e9fca => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:24.408445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a5cb-2c7e-4599-b3af-c956fd133f41 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.409117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a5cb-2c7e-4599-b3af-c956fd133f41 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.409604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54a5cb-2c7e-4599-b3af-c956fd133f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.414797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1117/2209] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:24 2022] DELETE /identity/v3/users/87fc1c400ceb4424848bc3f57625f85d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:24.419172 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fd31b-f9b0-439f-ab56-abcee7d3c7b3 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.419462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fd31b-f9b0-439f-ab56-abcee7d3c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.419744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fd31b-f9b0-439f-ab56-abcee7d3c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.441822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cb54a5cb-2c7e-4599-b3af-c956fd133f41 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:24.442010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d11fd31b-f9b0-439f-ab56-abcee7d3c7b3 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:24.443737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d11fd31b-f9b0-439f-ab56-abcee7d3c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:24.447066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cb54a5cb-2c7e-4599-b3af-c956fd133f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:24.472912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:24.533460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:24.534254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1118/2210] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:24.546919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fd31b-f9b0-439f-ab56-abcee7d3c7b3 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:24.548403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d11fd31b-f9b0-439f-ab56-abcee7d3c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:24.585678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1093/2211] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:24.588264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fee7f-2301-4972-b1ee-1690f7a1f886 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.588754 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fee7f-2301-4972-b1ee-1690f7a1f886 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.589014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fee7f-2301-4972-b1ee-1690f7a1f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.615309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5d4fee7f-2301-4972-b1ee-1690f7a1f886 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:24.616638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5d4fee7f-2301-4972-b1ee-1690f7a1f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:24.626854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1094/2212] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:10:24.635959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fee7f-2301-4972-b1ee-1690f7a1f886 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:24.658516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fee7f-2301-4972-b1ee-1690f7a1f886 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:24.668238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bc0a3-8e2e-4342-8b38-c3861a94f3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:24.669138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bc0a3-8e2e-4342-8b38-c3861a94f3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.669775 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bc0a3-8e2e-4342-8b38-c3861a94f3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.670394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bc0a3-8e2e-4342-8b38-c3861a94f3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.671767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bc0a3-8e2e-4342-8b38-c3861a94f3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:10:24.672296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bc0a3-8e2e-4342-8b38-c3861a94f3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:24.674670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bc0a3-8e2e-4342-8b38-c3861a94f3ae admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:24.686198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fd31b-f9b0-439f-ab56-abcee7d3c7b3 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:24.701235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1095/2213] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:10:24.701998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47d3d4-d088-459e-8f05-aa989b04da33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:24.702546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47d3d4-d088-459e-8f05-aa989b04da33 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.702834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47d3d4-d088-459e-8f05-aa989b04da33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.703152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47d3d4-d088-459e-8f05-aa989b04da33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.703962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bc0a3-8e2e-4342-8b38-c3861a94f3ae admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:24.719954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bc0a3-8e2e-4342-8b38-c3861a94f3ae admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:24.722800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47d3d4-d088-459e-8f05-aa989b04da33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:24.725863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9d65f-ae8b-4be7-ab27-9dd7e58b5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:24.727010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9d65f-ae8b-4be7-ab27-9dd7e58b5791 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.727475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9d65f-ae8b-4be7-ab27-9dd7e58b5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.727932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9d65f-ae8b-4be7-ab27-9dd7e58b5791 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.728793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9d65f-ae8b-4be7-ab27-9dd7e58b5791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:24.729108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47d3d4-d088-459e-8f05-aa989b04da33 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:24.731370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9d65f-ae8b-4be7-ab27-9dd7e58b5791 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:24.763070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1119/2214] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:10:24.776890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1096/2215] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:24 2022] POST /identity/v3/projects => generated 399 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:24.782124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47d3d4-d088-459e-8f05-aa989b04da33 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:24.792712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47d3d4-d088-459e-8f05-aa989b04da33 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:24.880372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e82d-0156-4ebb-891f-e2921f75000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:24.881762 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e82d-0156-4ebb-891f-e2921f75000f admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.882141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e82d-0156-4ebb-891f-e2921f75000f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.882551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e82d-0156-4ebb-891f-e2921f75000f admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.883330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62e82d-0156-4ebb-891f-e2921f75000f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:24.885395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62e82d-0156-4ebb-891f-e2921f75000f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:24.911808 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1120/2216] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:24 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:24.913209 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9d65f-ae8b-4be7-ab27-9dd7e58b5791 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:24.927046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9d65f-ae8b-4be7-ab27-9dd7e58b5791 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:24.932727 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594e9a5-1ea7-4037-97cf-bba4c8a4aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:24.934221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594e9a5-1ea7-4037-97cf-bba4c8a4aa6f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.934221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594e9a5-1ea7-4037-97cf-bba4c8a4aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.934221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594e9a5-1ea7-4037-97cf-bba4c8a4aa6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.934619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594e9a5-1ea7-4037-97cf-bba4c8a4aa6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:24.936250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594e9a5-1ea7-4037-97cf-bba4c8a4aa6f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:24.952274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1097/2217] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:24.953266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e82d-0156-4ebb-891f-e2921f75000f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:24.966023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e82d-0156-4ebb-891f-e2921f75000f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:24.973413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d31c09-8516-4d26-aa65-7e44670a0257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:24.974477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d31c09-8516-4d26-aa65-7e44670a0257 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:24.975042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d31c09-8516-4d26-aa65-7e44670a0257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:24.975426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d31c09-8516-4d26-aa65-7e44670a0257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:24.976375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d31c09-8516-4d26-aa65-7e44670a0257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:24.978305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d31c09-8516-4d26-aa65-7e44670a0257 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:24.989432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1121/2218] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:10:24.994706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594e9a5-1ea7-4037-97cf-bba4c8a4aa6f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:25.007599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594e9a5-1ea7-4037-97cf-bba4c8a4aa6f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:25.014470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17623d-6fff-497b-993b-c48ede9a12de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:25.015488 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17623d-6fff-497b-993b-c48ede9a12de admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.015644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17623d-6fff-497b-993b-c48ede9a12de admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.015978 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17623d-6fff-497b-993b-c48ede9a12de admin admin] PATH_INFO: `/v3/projects/1190b1e8e3e246f2bc0d5f4890cf1fcd/users/91e7e35a4aeb42a084eee218483a1944/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.031994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17623d-6fff-497b-993b-c48ede9a12de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1190b1e8e3e246f2bc0d5f4890cf1fcd, user_id=91e7e35a4aeb42a084eee218483a1944, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:25.034706 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17623d-6fff-497b-993b-c48ede9a12de admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:25.049936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1098/2219] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:24 2022] PUT /identity/v3/projects/1190b1e8e3e246f2bc0d5f4890cf1fcd/users/91e7e35a4aeb42a084eee218483a1944/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:10:25.061458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132187e-22a4-4fbc-a152-99eb60214540 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.061750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132187e-22a4-4fbc-a152-99eb60214540 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.062064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132187e-22a4-4fbc-a152-99eb60214540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.094552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-3132187e-22a4-4fbc-a152-99eb60214540 None None] MFA Rules not processed for user `91e7e35a4aeb42a084eee218483a1944`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:25.095875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3132187e-22a4-4fbc-a152-99eb60214540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:25.140266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17623d-6fff-497b-993b-c48ede9a12de admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:25.142139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6e17623d-6fff-497b-993b-c48ede9a12de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:25.173016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:25.248052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1122/2220] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:25.256104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132187e-22a4-4fbc-a152-99eb60214540 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:25.258300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3132187e-22a4-4fbc-a152-99eb60214540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:25.271118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17623d-6fff-497b-993b-c48ede9a12de admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:25.279021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:25.280803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.281166 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.281519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] PATH_INFO: `/v3/projects/8c661cd5e50c47a4aed3655f5233ac6b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.282926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c661cd5e50c47a4aed3655f5233ac6b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:25.285816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:25.341791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132187e-22a4-4fbc-a152-99eb60214540 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:25.353091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c661cd5e50c47a4aed3655f5233ac6b', 'request_id': 'req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:25.361102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c661cd5e50c47a4aed3655f5233ac6b', 'request_id': 'req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:25.368782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c661cd5e50c47a4aed3655f5233ac6b', 'request_id': 'req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:25.371926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:25.392152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] The token cache is being invalidate because project 8c661cd5e50c47a4aed3655f5233ac6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:25.392441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:25.393125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2da2103-5e0c-4217-87b7-964ef1dbe4d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:25.399654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1f41b-6208-4cc7-b543-a01d03089dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:25.403623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1099/2221] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:25 2022] DELETE /identity/v3/projects/8c661cd5e50c47a4aed3655f5233ac6b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:10:25.403776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f41b-6208-4cc7-b543-a01d03089dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.403776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f41b-6208-4cc7-b543-a01d03089dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.403776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f41b-6208-4cc7-b543-a01d03089dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.403776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-52f1f41b-6208-4cc7-b543-a01d03089dd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:25.406096 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500440ac-b869-4848-a10b-1008a1273d38 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.406380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500440ac-b869-4848-a10b-1008a1273d38 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.406681 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500440ac-b869-4848-a10b-1008a1273d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.428772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-500440ac-b869-4848-a10b-1008a1273d38 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:25.430049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-500440ac-b869-4848-a10b-1008a1273d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:25.481847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1f41b-6208-4cc7-b543-a01d03089dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:25.483463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1f41b-6208-4cc7-b543-a01d03089dd6 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:25.496115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1123/2222] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:25.526564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1100/2223] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:25.531909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f183e45-0458-490a-a70c-bf342c285c1b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.532200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f183e45-0458-490a-a70c-bf342c285c1b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.532479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f183e45-0458-490a-a70c-bf342c285c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.554585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-3f183e45-0458-490a-a70c-bf342c285c1b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:25.555797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3f183e45-0458-490a-a70c-bf342c285c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:25.564059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1124/2224] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:25.568629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500440ac-b869-4848-a10b-1008a1273d38 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:25.578454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500440ac-b869-4848-a10b-1008a1273d38 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:25.586891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9546a-b0d1-42cb-8d96-3edc4a337a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:25.587767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9546a-b0d1-42cb-8d96-3edc4a337a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.588513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9546a-b0d1-42cb-8d96-3edc4a337a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.588513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9546a-b0d1-42cb-8d96-3edc4a337a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.589283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9546a-b0d1-42cb-8d96-3edc4a337a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:10:25.589864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9546a-b0d1-42cb-8d96-3edc4a337a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:25.591595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9546a-b0d1-42cb-8d96-3edc4a337a28 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:25.605133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1101/2225] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 02:10:25.609564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f183e45-0458-490a-a70c-bf342c285c1b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:25.618896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f183e45-0458-490a-a70c-bf342c285c1b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:25.626536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74e00d-73b6-48b7-a725-c22145569844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:25.627157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74e00d-73b6-48b7-a725-c22145569844 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.627502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74e00d-73b6-48b7-a725-c22145569844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.627698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74e00d-73b6-48b7-a725-c22145569844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.628363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74e00d-73b6-48b7-a725-c22145569844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:25.630366 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74e00d-73b6-48b7-a725-c22145569844 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:25.665086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1125/2226] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:25 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:25.668417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9546a-b0d1-42cb-8d96-3edc4a337a28 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:25.681488 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9546a-b0d1-42cb-8d96-3edc4a337a28 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:25.759875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb985f3-749b-42c4-b0a9-9eaa587ccdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:25.760675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb985f3-749b-42c4-b0a9-9eaa587ccdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.760963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb985f3-749b-42c4-b0a9-9eaa587ccdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.761239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb985f3-749b-42c4-b0a9-9eaa587ccdd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.763375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb985f3-749b-42c4-b0a9-9eaa587ccdd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:25.764438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb985f3-749b-42c4-b0a9-9eaa587ccdd4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:25.798707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1102/2227] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:25 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:25.800154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74e00d-73b6-48b7-a725-c22145569844 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:25.813753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74e00d-73b6-48b7-a725-c22145569844 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:25.822718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb77722-e174-4eac-b417-fd58a85192cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:25.823843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb77722-e174-4eac-b417-fd58a85192cd admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.824130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb77722-e174-4eac-b417-fd58a85192cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.824410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb77722-e174-4eac-b417-fd58a85192cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.825559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb77722-e174-4eac-b417-fd58a85192cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:25.828348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb77722-e174-4eac-b417-fd58a85192cd admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:25.849058 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1126/2228] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:25.851813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb985f3-749b-42c4-b0a9-9eaa587ccdd4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:25.863572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb985f3-749b-42c4-b0a9-9eaa587ccdd4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:25.872957 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db384046-56a7-404c-8567-1c2fd935d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:25.874537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384046-56a7-404c-8567-1c2fd935d51b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.874537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384046-56a7-404c-8567-1c2fd935d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.874537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384046-56a7-404c-8567-1c2fd935d51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.875313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db384046-56a7-404c-8567-1c2fd935d51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:25.877072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db384046-56a7-404c-8567-1c2fd935d51b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:25.898505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1103/2229] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:25.903308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb77722-e174-4eac-b417-fd58a85192cd admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:25.919597 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb77722-e174-4eac-b417-fd58a85192cd admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:25.924787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e9f0-f228-41c7-bdda-48ec961ced23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:25.925455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e9f0-f228-41c7-bdda-48ec961ced23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.925739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e9f0-f228-41c7-bdda-48ec961ced23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.926015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e9f0-f228-41c7-bdda-48ec961ced23 admin admin] PATH_INFO: `/v3/projects/7accdeefce894443926b2e89fcd0252b/users/805d7ad608c643d39a6f2193e88f54b5/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:25.929152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:25.947653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3e9f0-f228-41c7-bdda-48ec961ced23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7accdeefce894443926b2e89fcd0252b, user_id=805d7ad608c643d39a6f2193e88f54b5, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:25.951275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3e9f0-f228-41c7-bdda-48ec961ced23 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:25.987640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1127/2230] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:25 2022] PUT /identity/v3/projects/7accdeefce894443926b2e89fcd0252b/users/805d7ad608c643d39a6f2193e88f54b5/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:25.998458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c161f8-226d-407d-8a58-e0d170f58dff None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:25.998915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c161f8-226d-407d-8a58-e0d170f58dff None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:25.999006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c161f8-226d-407d-8a58-e0d170f58dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:26.047914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e6c161f8-226d-407d-8a58-e0d170f58dff None None] MFA Rules not processed for user `805d7ad608c643d39a6f2193e88f54b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:26.049174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e6c161f8-226d-407d-8a58-e0d170f58dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:26.107666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:26.133218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1104/2231] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:26.145403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e9f0-f228-41c7-bdda-48ec961ced23 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:26.147776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-24c3e9f0-f228-41c7-bdda-48ec961ced23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:26.214385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e9f0-f228-41c7-bdda-48ec961ced23 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:26.221913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e665ce-9095-491a-b0b4-8c2523e1d952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:26.222906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e665ce-9095-491a-b0b4-8c2523e1d952 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:26.223388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e665ce-9095-491a-b0b4-8c2523e1d952 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:26.223766 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e665ce-9095-491a-b0b4-8c2523e1d952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:26.234092 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e665ce-9095-491a-b0b4-8c2523e1d952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:26.235714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e665ce-9095-491a-b0b4-8c2523e1d952 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:26.247792 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1128/2232] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:26.979026 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c161f8-226d-407d-8a58-e0d170f58dff None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:26.980489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e6c161f8-226d-407d-8a58-e0d170f58dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:27.044588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c161f8-226d-407d-8a58-e0d170f58dff None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:27.049131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:27.049759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:27.050036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:27.050307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] PATH_INFO: `/v3/users/13e9d9de0a6745be91c4f0a33eaa545e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:27.051511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e9d9de0a6745be91c4f0a33eaa545e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:27.054034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:27.104692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e9d9de0a6745be91c4f0a33eaa545e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.105617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e9d9de0a6745be91c4f0a33eaa545e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.112590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e9d9de0a6745be91c4f0a33eaa545e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.124772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e9d9de0a6745be91c4f0a33eaa545e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.125417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e9d9de0a6745be91c4f0a33eaa545e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.137409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1105/2233] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:26 2022] DELETE /identity/v3/users/13e9d9de0a6745be91c4f0a33eaa545e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:27.142084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40ab5c-1b58-4623-9da1-9ca35ca277b1 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:27.142648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40ab5c-1b58-4623-9da1-9ca35ca277b1 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:27.142738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40ab5c-1b58-4623-9da1-9ca35ca277b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:27.163818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ce40ab5c-1b58-4623-9da1-9ca35ca277b1 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:27.165016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ce40ab5c-1b58-4623-9da1-9ca35ca277b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:27.222570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1129/2234] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:10:27.233622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:27.235048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:27.294477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f05b25-afae-4f8c-bdb6-31dc39819cbf admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:27.298923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca07af-8055-4679-aa4b-2b88d87071f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:27.299866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca07af-8055-4679-aa4b-2b88d87071f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:27.300174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca07af-8055-4679-aa4b-2b88d87071f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:27.300515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca07af-8055-4679-aa4b-2b88d87071f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:27.312099 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca07af-8055-4679-aa4b-2b88d87071f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:27.313555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca07af-8055-4679-aa4b-2b88d87071f5 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:27.324344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1106/2235] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:27.603572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40ab5c-1b58-4623-9da1-9ca35ca277b1 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:27.605120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ce40ab5c-1b58-4623-9da1-9ca35ca277b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:27.618261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40ab5c-1b58-4623-9da1-9ca35ca277b1 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:27.623175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:27.624921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:27.625260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:27.625547 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] PATH_INFO: `/v3/projects/f215a6341eeb4422b746ee8ab20a420a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:27.627198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f215a6341eeb4422b746ee8ab20a420a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:27.629440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:27.681889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f215a6341eeb4422b746ee8ab20a420a', 'request_id': 'req-2bfa9016-1888-47f6-8ff5-1c54230ce234'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.690686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f215a6341eeb4422b746ee8ab20a420a', 'request_id': 'req-2bfa9016-1888-47f6-8ff5-1c54230ce234'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.697074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f215a6341eeb4422b746ee8ab20a420a', 'request_id': 'req-2bfa9016-1888-47f6-8ff5-1c54230ce234'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.712894 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] The token cache is being invalidate because project f215a6341eeb4422b746ee8ab20a420a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:27.713180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.713843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.715415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1130/2236] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:27 2022] DELETE /identity/v3/projects/f215a6341eeb4422b746ee8ab20a420a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:27.719246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca07af-8055-4679-aa4b-2b88d87071f5 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:27.728672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca07af-8055-4679-aa4b-2b88d87071f5 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:27.736241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:27.794743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:27.795411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:27.795761 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:27.796103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] PATH_INFO: `/v3/users/f2f10f94476149549f8769b3cab725d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:27.797674 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f10f94476149549f8769b3cab725d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:27.799884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:27.858829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f10f94476149549f8769b3cab725d0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.864063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f10f94476149549f8769b3cab725d0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.884343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f10f94476149549f8769b3cab725d0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.899974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f10f94476149549f8769b3cab725d0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.900692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fc5484b-b7f4-4aea-94e7-df3b20e826c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f10f94476149549f8769b3cab725d0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:27.917237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1107/2237] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:27 2022] DELETE /identity/v3/users/f2f10f94476149549f8769b3cab725d0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:28.251963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:28.253529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:28.270274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa9016-1888-47f6-8ff5-1c54230ce234 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:28.279472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:28.341257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:28.341801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:28.342077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:28.342346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] PATH_INFO: `/v3/projects/c52a30971cf140f088bce324bf16c004` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:28.343542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52a30971cf140f088bce324bf16c004)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:28.345447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:28.419248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52a30971cf140f088bce324bf16c004', 'request_id': 'req-2afb27f7-7248-41f5-8494-f5ca55e45039'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:28.419248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52a30971cf140f088bce324bf16c004', 'request_id': 'req-2afb27f7-7248-41f5-8494-f5ca55e45039'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:28.426581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52a30971cf140f088bce324bf16c004', 'request_id': 'req-2afb27f7-7248-41f5-8494-f5ca55e45039'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:28.439677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] The token cache is being invalidate because project c52a30971cf140f088bce324bf16c004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:28.440084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:28.440736 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-2afb27f7-7248-41f5-8494-f5ca55e45039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:28.442229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1131/2238] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:28 2022] DELETE /identity/v3/projects/c52a30971cf140f088bce324bf16c004 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:28.447082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f6271-b7cc-4535-ab3e-f193789814d0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:28.447541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f6271-b7cc-4535-ab3e-f193789814d0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:28.447744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f6271-b7cc-4535-ab3e-f193789814d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:28.467400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-017f6271-b7cc-4535-ab3e-f193789814d0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:28.468588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-017f6271-b7cc-4535-ab3e-f193789814d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:28.534370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1108/2239] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:10:28.542520 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7e99f-8760-4402-b6a4-7470e792f80b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:28.542750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7e99f-8760-4402-b6a4-7470e792f80b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:28.543022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7e99f-8760-4402-b6a4-7470e792f80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:28.568927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-95e7e99f-8760-4402-b6a4-7470e792f80b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:28.570845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-95e7e99f-8760-4402-b6a4-7470e792f80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:28.584366 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1132/2240] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:28.585527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f6271-b7cc-4535-ab3e-f193789814d0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:28.596273 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f6271-b7cc-4535-ab3e-f193789814d0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:28.608694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fd8b5-c723-481c-9294-aa22e0d91efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:28.609351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fd8b5-c723-481c-9294-aa22e0d91efa admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:28.609632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fd8b5-c723-481c-9294-aa22e0d91efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:28.609901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fd8b5-c723-481c-9294-aa22e0d91efa admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:28.610641 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fd8b5-c723-481c-9294-aa22e0d91efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:10:28.610947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fd8b5-c723-481c-9294-aa22e0d91efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:28.612898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fd8b5-c723-481c-9294-aa22e0d91efa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:28.629110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1109/2241] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:10:28.633631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7e99f-8760-4402-b6a4-7470e792f80b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:28.643991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7e99f-8760-4402-b6a4-7470e792f80b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:28.652253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9745b2-bbcb-4831-9f33-7506c202f209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:28.652892 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9745b2-bbcb-4831-9f33-7506c202f209 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:28.653177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9745b2-bbcb-4831-9f33-7506c202f209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:28.653452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9745b2-bbcb-4831-9f33-7506c202f209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:28.654131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9745b2-bbcb-4831-9f33-7506c202f209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:28.656090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9745b2-bbcb-4831-9f33-7506c202f209 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:28.688745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1133/2242] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:28 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:28.693228 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fd8b5-c723-481c-9294-aa22e0d91efa admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:28.703735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fd8b5-c723-481c-9294-aa22e0d91efa admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:28.717857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:28.774384 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec644d2-68a4-4b97-b531-91ea107bebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:28.775154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec644d2-68a4-4b97-b531-91ea107bebee admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:28.775505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec644d2-68a4-4b97-b531-91ea107bebee admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:28.775980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec644d2-68a4-4b97-b531-91ea107bebee admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:28.776588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec644d2-68a4-4b97-b531-91ea107bebee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:28.778683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec644d2-68a4-4b97-b531-91ea107bebee admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:28.806749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1110/2243] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:28 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:28.808295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9745b2-bbcb-4831-9f33-7506c202f209 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:28.821430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9745b2-bbcb-4831-9f33-7506c202f209 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:28.827624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb659b6-ea25-4eb7-8ee1-78d1a41336c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:28.828364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb659b6-ea25-4eb7-8ee1-78d1a41336c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:28.828642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb659b6-ea25-4eb7-8ee1-78d1a41336c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:28.830433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb659b6-ea25-4eb7-8ee1-78d1a41336c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:28.831187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb659b6-ea25-4eb7-8ee1-78d1a41336c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:28.832795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb659b6-ea25-4eb7-8ee1-78d1a41336c9 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:28.846297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1134/2244] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:28.850704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec644d2-68a4-4b97-b531-91ea107bebee admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:28.861664 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec644d2-68a4-4b97-b531-91ea107bebee admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:28.866668 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bd027-3aa5-4ba4-9134-cb3582c2ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:28.867372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bd027-3aa5-4ba4-9134-cb3582c2ed98 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:28.867556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bd027-3aa5-4ba4-9134-cb3582c2ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:28.867827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bd027-3aa5-4ba4-9134-cb3582c2ed98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:28.868539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bd027-3aa5-4ba4-9134-cb3582c2ed98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:28.870278 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bd027-3aa5-4ba4-9134-cb3582c2ed98 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:28.884729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1111/2245] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:10:28.886854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb659b6-ea25-4eb7-8ee1-78d1a41336c9 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:28.898921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb659b6-ea25-4eb7-8ee1-78d1a41336c9 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:28.905232 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c16fee-9910-4164-9c6d-31b1932f14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:28.906108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16fee-9910-4164-9c6d-31b1932f14ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:28.906520 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16fee-9910-4164-9c6d-31b1932f14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:28.907625 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16fee-9910-4164-9c6d-31b1932f14ef admin admin] PATH_INFO: `/v3/projects/b6dbb5c5b87848f0baeaf8ade1b4debf/users/41d675ced8f748189098fd8c58506534/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:28.954918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c16fee-9910-4164-9c6d-31b1932f14ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dbb5c5b87848f0baeaf8ade1b4debf, user_id=41d675ced8f748189098fd8c58506534, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:28.957891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c16fee-9910-4164-9c6d-31b1932f14ef admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:28.981270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1135/2246] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:28 2022] PUT /identity/v3/projects/b6dbb5c5b87848f0baeaf8ade1b4debf/users/41d675ced8f748189098fd8c58506534/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:10:28.983454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae67ea-c1c5-4568-9f42-2534c5ea5cf9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:28.983815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae67ea-c1c5-4568-9f42-2534c5ea5cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:28.984130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae67ea-c1c5-4568-9f42-2534c5ea5cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:29.016189 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a1ae67ea-c1c5-4568-9f42-2534c5ea5cf9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:29.017514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a1ae67ea-c1c5-4568-9f42-2534c5ea5cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:29.098635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1112/2247] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:29.108387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c16fee-9910-4164-9c6d-31b1932f14ef admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:29.110091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-59c16fee-9910-4164-9c6d-31b1932f14ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:29.160585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:29.187598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c16fee-9910-4164-9c6d-31b1932f14ef admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:29.191983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae46a-54b6-476d-94ae-2cd9ffae02e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:29.192608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae46a-54b6-476d-94ae-2cd9ffae02e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:29.193780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae46a-54b6-476d-94ae-2cd9ffae02e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:29.194548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae46a-54b6-476d-94ae-2cd9ffae02e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:29.206841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ae46a-54b6-476d-94ae-2cd9ffae02e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:29.209014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ae46a-54b6-476d-94ae-2cd9ffae02e3 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:29.222735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1136/2248] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:29.953177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171c2b5-a822-487e-b8ad-eb258ae2f8d7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:29.953681 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171c2b5-a822-487e-b8ad-eb258ae2f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:29.953773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171c2b5-a822-487e-b8ad-eb258ae2f8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:29.984236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7171c2b5-a822-487e-b8ad-eb258ae2f8d7 None None] MFA Rules not processed for user `41d675ced8f748189098fd8c58506534`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:29.985444 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7171c2b5-a822-487e-b8ad-eb258ae2f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:30.059673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1113/2249] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:30.064658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae46a-54b6-476d-94ae-2cd9ffae02e3 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:30.075310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae46a-54b6-476d-94ae-2cd9ffae02e3 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:30.080288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79633d8a-7128-4ed3-b9af-e54342e68042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:30.080570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633d8a-7128-4ed3-b9af-e54342e68042 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:30.080795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633d8a-7128-4ed3-b9af-e54342e68042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:30.081071 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633d8a-7128-4ed3-b9af-e54342e68042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:30.081737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79633d8a-7128-4ed3-b9af-e54342e68042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:30.084278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79633d8a-7128-4ed3-b9af-e54342e68042 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:30.124794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1137/2250] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:30 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:30.128776 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171c2b5-a822-487e-b8ad-eb258ae2f8d7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:30.140072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171c2b5-a822-487e-b8ad-eb258ae2f8d7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:30.166466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:30.209303 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e5eac-af58-458a-a733-59869a4322ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:30.210058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e5eac-af58-458a-a733-59869a4322ae admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:30.210366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e5eac-af58-458a-a733-59869a4322ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:30.210736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e5eac-af58-458a-a733-59869a4322ae admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:30.211497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e5eac-af58-458a-a733-59869a4322ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:30.213752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e5eac-af58-458a-a733-59869a4322ae admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:30.235104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1114/2251] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:30 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:30.239082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79633d8a-7128-4ed3-b9af-e54342e68042 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:30.250375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79633d8a-7128-4ed3-b9af-e54342e68042 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:30.254974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ee85c-6abe-4d4e-948a-768bb8c63f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:30.255630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ee85c-6abe-4d4e-948a-768bb8c63f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:30.256424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ee85c-6abe-4d4e-948a-768bb8c63f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:30.256725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ee85c-6abe-4d4e-948a-768bb8c63f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:30.257424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ee85c-6abe-4d4e-948a-768bb8c63f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:30.259075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ee85c-6abe-4d4e-948a-768bb8c63f4f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:30.269507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1138/2252] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:30.273665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e5eac-af58-458a-a733-59869a4322ae admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:30.285057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e5eac-af58-458a-a733-59869a4322ae admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:30.290145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388110fe-a3d7-489a-8c3b-2a7ed9754670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:30.290870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388110fe-a3d7-489a-8c3b-2a7ed9754670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:30.291362 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388110fe-a3d7-489a-8c3b-2a7ed9754670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:30.291689 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388110fe-a3d7-489a-8c3b-2a7ed9754670 admin admin] PATH_INFO: `/v3/projects/81e25768b7bb40758c28ed6b3bbf44e4/users/f9cd0de007174a40b6abc404bedd25c9/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:30.310337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388110fe-a3d7-489a-8c3b-2a7ed9754670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e25768b7bb40758c28ed6b3bbf44e4, user_id=f9cd0de007174a40b6abc404bedd25c9, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:30.313118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388110fe-a3d7-489a-8c3b-2a7ed9754670 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:30.335766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1115/2253] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:30 2022] PUT /identity/v3/projects/81e25768b7bb40758c28ed6b3bbf44e4/users/f9cd0de007174a40b6abc404bedd25c9/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:10:30.339714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ee85c-6abe-4d4e-948a-768bb8c63f4f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:30.350256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ee85c-6abe-4d4e-948a-768bb8c63f4f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:30.414430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665d003-8c1e-4354-b7a4-fcf06d8d7d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:30.415090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d003-8c1e-4354-b7a4-fcf06d8d7d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:30.415461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d003-8c1e-4354-b7a4-fcf06d8d7d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:30.415636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d003-8c1e-4354-b7a4-fcf06d8d7d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:30.416343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665d003-8c1e-4354-b7a4-fcf06d8d7d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:30.417963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665d003-8c1e-4354-b7a4-fcf06d8d7d9a admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:30.429407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1139/2254] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:10:30.433702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388110fe-a3d7-489a-8c3b-2a7ed9754670 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:30.444884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388110fe-a3d7-489a-8c3b-2a7ed9754670 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:30.449586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b10e4-bbb6-4774-a77f-9290d0b37a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:30.450249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b10e4-bbb6-4774-a77f-9290d0b37a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:30.450583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b10e4-bbb6-4774-a77f-9290d0b37a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:30.450827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b10e4-bbb6-4774-a77f-9290d0b37a99 admin admin] PATH_INFO: `/v3/projects/81e25768b7bb40758c28ed6b3bbf44e4/users/f9cd0de007174a40b6abc404bedd25c9/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:30.452891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b10e4-bbb6-4774-a77f-9290d0b37a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e25768b7bb40758c28ed6b3bbf44e4, user_id=f9cd0de007174a40b6abc404bedd25c9, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:30.455600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b10e4-bbb6-4774-a77f-9290d0b37a99 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:30.467804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1116/2255] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:30 2022] PUT /identity/v3/projects/81e25768b7bb40758c28ed6b3bbf44e4/users/f9cd0de007174a40b6abc404bedd25c9/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:10:31.200498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb7c1e-5639-4136-9b69-41d38bbf4efb None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:31.201351 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb7c1e-5639-4136-9b69-41d38bbf4efb None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:31.201721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb7c1e-5639-4136-9b69-41d38bbf4efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:31.230657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f1fb7c1e-5639-4136-9b69-41d38bbf4efb None None] MFA Rules not processed for user `f9cd0de007174a40b6abc404bedd25c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:31.241628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f1fb7c1e-5639-4136-9b69-41d38bbf4efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:31.389874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1140/2256] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:31.403962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a514-4105-42ce-979c-d3dbf9562114 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:31.404450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a514-4105-42ce-979c-d3dbf9562114 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:31.404631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a514-4105-42ce-979c-d3dbf9562114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:31.453832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-edb8a514-4105-42ce-979c-d3dbf9562114 None None] MFA Rules not processed for user `41d675ced8f748189098fd8c58506534`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:31.455582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-edb8a514-4105-42ce-979c-d3dbf9562114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:31.523315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1117/2257] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:31.544154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb7c1e-5639-4136-9b69-41d38bbf4efb None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:31.545670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f1fb7c1e-5639-4136-9b69-41d38bbf4efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:31.590786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:31.680486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb7c1e-5639-4136-9b69-41d38bbf4efb None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:31.688259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4ac76-a263-4785-969a-dbb2c7ef744e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:31.688907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4ac76-a263-4785-969a-dbb2c7ef744e service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:31.689187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4ac76-a263-4785-969a-dbb2c7ef744e service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:31.690526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4ac76-a263-4785-969a-dbb2c7ef744e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:31.700247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4ac76-a263-4785-969a-dbb2c7ef744e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:31.702428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4ac76-a263-4785-969a-dbb2c7ef744e service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:31.713305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1141/2258] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:32.760506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4ca8-c1ba-4553-bcd9-5035d4759e9b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:32.761158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4ca8-c1ba-4553-bcd9-5035d4759e9b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:32.762093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4ca8-c1ba-4553-bcd9-5035d4759e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:32.790700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-304a4ca8-c1ba-4553-bcd9-5035d4759e9b None None] MFA Rules not processed for user `b90cb62ab0a643ea939e00f81fea1b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:32.791906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-304a4ca8-c1ba-4553-bcd9-5035d4759e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:32.896514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1118/2259] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:10:32.922350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4ac76-a263-4785-969a-dbb2c7ef744e service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:32.923879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-36c4ac76-a263-4785-969a-dbb2c7ef744e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:33.068493 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4ac76-a263-4785-969a-dbb2c7ef744e service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:33.074089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:33.074761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:33.075193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:33.075612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] PATH_INFO: `/v3/users/91e7e35a4aeb42a084eee218483a1944` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:33.076943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e7e35a4aeb42a084eee218483a1944)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:33.079074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:33.176398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e7e35a4aeb42a084eee218483a1944'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:33.177964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e7e35a4aeb42a084eee218483a1944'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:33.189010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e7e35a4aeb42a084eee218483a1944'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:33.203850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e7e35a4aeb42a084eee218483a1944'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:33.204523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e7e35a4aeb42a084eee218483a1944'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:33.219844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1142/2260] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:32 2022] DELETE /identity/v3/users/91e7e35a4aeb42a084eee218483a1944 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:33.224364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af26f4-2b3d-4a73-ba36-a2b3d7f60527 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:33.224840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af26f4-2b3d-4a73-ba36-a2b3d7f60527 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:33.225143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af26f4-2b3d-4a73-ba36-a2b3d7f60527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:33.245721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-72af26f4-2b3d-4a73-ba36-a2b3d7f60527 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:33.246963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-72af26f4-2b3d-4a73-ba36-a2b3d7f60527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:33.291244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:33.339382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1119/2261] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:33.349392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:33.350841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:33.402309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:33.444514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bd5d4-931b-41db-a77d-2a3fe448e230 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:33.448782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2f53f-81bc-451d-b3d7-5dd2db9ae08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:33.450226 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2f53f-81bc-451d-b3d7-5dd2db9ae08a service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:33.450548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2f53f-81bc-451d-b3d7-5dd2db9ae08a service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:33.450824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2f53f-81bc-451d-b3d7-5dd2db9ae08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:33.477235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2f53f-81bc-451d-b3d7-5dd2db9ae08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:33.481503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2f53f-81bc-451d-b3d7-5dd2db9ae08a service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:33.507694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1143/2262] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:33.910588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af26f4-2b3d-4a73-ba36-a2b3d7f60527 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:33.913304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-72af26f4-2b3d-4a73-ba36-a2b3d7f60527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:33.945873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af26f4-2b3d-4a73-ba36-a2b3d7f60527 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:33.951396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:33.952591 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:33.967218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:33.967721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] PATH_INFO: `/v3/projects/1190b1e8e3e246f2bc0d5f4890cf1fcd` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:33.969965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1190b1e8e3e246f2bc0d5f4890cf1fcd)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:33.975085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:34.031091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1190b1e8e3e246f2bc0d5f4890cf1fcd', 'request_id': 'req-0be5370f-024f-4e4b-b4a8-53343dacef40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:34.037778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1190b1e8e3e246f2bc0d5f4890cf1fcd', 'request_id': 'req-0be5370f-024f-4e4b-b4a8-53343dacef40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:34.049252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1190b1e8e3e246f2bc0d5f4890cf1fcd', 'request_id': 'req-0be5370f-024f-4e4b-b4a8-53343dacef40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:34.068451 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] The token cache is being invalidate because project 1190b1e8e3e246f2bc0d5f4890cf1fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:34.068854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:34.069688 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0be5370f-024f-4e4b-b4a8-53343dacef40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:34.071463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1120/2263] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:33 2022] DELETE /identity/v3/projects/1190b1e8e3e246f2bc0d5f4890cf1fcd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:36.829672 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2f53f-81bc-451d-b3d7-5dd2db9ae08a service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:36.831155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-edd2f53f-81bc-451d-b3d7-5dd2db9ae08a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:36.844175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2f53f-81bc-451d-b3d7-5dd2db9ae08a service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:36.914333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:36.915016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:36.915313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:36.915590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] PATH_INFO: `/v3/users/805d7ad608c643d39a6f2193e88f54b5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:36.916798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=805d7ad608c643d39a6f2193e88f54b5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:36.918816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:36.967371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805d7ad608c643d39a6f2193e88f54b5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:36.968143 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805d7ad608c643d39a6f2193e88f54b5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:36.976815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805d7ad608c643d39a6f2193e88f54b5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:36.989208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805d7ad608c643d39a6f2193e88f54b5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:36.989905 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805d7ad608c643d39a6f2193e88f54b5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:37.004281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1144/2264] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:10:36 2022] DELETE /identity/v3/users/805d7ad608c643d39a6f2193e88f54b5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:37.008799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0acfe3-d5ac-42f4-9734-e2821fe1e2f7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:37.009283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0acfe3-d5ac-42f4-9734-e2821fe1e2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:37.009379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0acfe3-d5ac-42f4-9734-e2821fe1e2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:37.029551 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0d0acfe3-d5ac-42f4-9734-e2821fe1e2f7 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:37.030812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0d0acfe3-d5ac-42f4-9734-e2821fe1e2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:37.103822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1121/2265] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:37.111091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:37.112587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:37.180292 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d6047-b86d-4767-a79d-a5970b91d92d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:37.185266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e7fca-99ef-487b-8ec9-0f1241fcff41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:37.185898 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e7fca-99ef-487b-8ec9-0f1241fcff41 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:37.186170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e7fca-99ef-487b-8ec9-0f1241fcff41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:37.186472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e7fca-99ef-487b-8ec9-0f1241fcff41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:37.197145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:37.199950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e7fca-99ef-487b-8ec9-0f1241fcff41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:37.202046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e7fca-99ef-487b-8ec9-0f1241fcff41 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:37.214229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1145/2266] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:37.724480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0acfe3-d5ac-42f4-9734-e2821fe1e2f7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:37.725886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0d0acfe3-d5ac-42f4-9734-e2821fe1e2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:37.737651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0acfe3-d5ac-42f4-9734-e2821fe1e2f7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:37.743058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:37.743701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:37.743981 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:37.744256 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] PATH_INFO: `/v3/projects/7accdeefce894443926b2e89fcd0252b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:37.745446 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7accdeefce894443926b2e89fcd0252b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:37.747567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:37.798963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:37.800798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7accdeefce894443926b2e89fcd0252b', 'request_id': 'req-4fa536df-805e-4b20-a773-6a4ebbcc69a0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:37.808636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7accdeefce894443926b2e89fcd0252b', 'request_id': 'req-4fa536df-805e-4b20-a773-6a4ebbcc69a0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:37.815749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7accdeefce894443926b2e89fcd0252b', 'request_id': 'req-4fa536df-805e-4b20-a773-6a4ebbcc69a0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:37.828497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] The token cache is being invalidate because project 7accdeefce894443926b2e89fcd0252b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:10:37.828788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:37.829405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4fa536df-805e-4b20-a773-6a4ebbcc69a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:10:37.830949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1122/2267] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:10:37 2022] DELETE /identity/v3/projects/7accdeefce894443926b2e89fcd0252b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:37.836045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66eb8-8c34-42bc-a084-b79bf467a605 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:37.836488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66eb8-8c34-42bc-a084-b79bf467a605 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:37.836651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66eb8-8c34-42bc-a084-b79bf467a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:37.855773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e0a66eb8-8c34-42bc-a084-b79bf467a605 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:37.856971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e0a66eb8-8c34-42bc-a084-b79bf467a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:37.924601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1146/2268] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:37.927781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b3e2a-5e35-42fe-b920-56616c55ce2c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:37.928463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b3e2a-5e35-42fe-b920-56616c55ce2c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:37.928816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b3e2a-5e35-42fe-b920-56616c55ce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:37.952070 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-927b3e2a-5e35-42fe-b920-56616c55ce2c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:37.953320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-927b3e2a-5e35-42fe-b920-56616c55ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:37.961264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1123/2269] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:37.965499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66eb8-8c34-42bc-a084-b79bf467a605 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:37.975779 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66eb8-8c34-42bc-a084-b79bf467a605 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:37.980412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00bc93-04ee-4c61-ad40-c9eacaa6000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:37.981018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00bc93-04ee-4c61-ad40-c9eacaa6000d admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:37.981299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00bc93-04ee-4c61-ad40-c9eacaa6000d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:37.981574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00bc93-04ee-4c61-ad40-c9eacaa6000d admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:37.982267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00bc93-04ee-4c61-ad40-c9eacaa6000d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:10:37.982721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00bc93-04ee-4c61-ad40-c9eacaa6000d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:37.984323 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00bc93-04ee-4c61-ad40-c9eacaa6000d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:37.996340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1147/2270] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:10:38.000357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b3e2a-5e35-42fe-b920-56616c55ce2c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:38.009737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b3e2a-5e35-42fe-b920-56616c55ce2c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:38.014379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95795b53-2c48-430a-bae5-71dc3a530d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:38.014999 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795b53-2c48-430a-bae5-71dc3a530d0f admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:38.015280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795b53-2c48-430a-bae5-71dc3a530d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:38.015551 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795b53-2c48-430a-bae5-71dc3a530d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:38.016220 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95795b53-2c48-430a-bae5-71dc3a530d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:38.018118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95795b53-2c48-430a-bae5-71dc3a530d0f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:38.049151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1124/2271] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:37 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:38.050198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00bc93-04ee-4c61-ad40-c9eacaa6000d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:38.060929 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00bc93-04ee-4c61-ad40-c9eacaa6000d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:38.126961 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8be52-5404-4375-8941-81cdd1d8fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:38.127768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8be52-5404-4375-8941-81cdd1d8fdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:38.128279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8be52-5404-4375-8941-81cdd1d8fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:38.128778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8be52-5404-4375-8941-81cdd1d8fdb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:38.130075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8be52-5404-4375-8941-81cdd1d8fdb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:38.132178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8be52-5404-4375-8941-81cdd1d8fdb6 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:38.153497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1148/2272] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:38 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:10:38.157574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95795b53-2c48-430a-bae5-71dc3a530d0f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:38.168682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95795b53-2c48-430a-bae5-71dc3a530d0f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:38.173596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81290f7-b090-45a2-9385-74a5430111f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:38.174200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81290f7-b090-45a2-9385-74a5430111f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:38.174511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81290f7-b090-45a2-9385-74a5430111f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:38.174841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81290f7-b090-45a2-9385-74a5430111f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:38.175487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81290f7-b090-45a2-9385-74a5430111f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:38.177108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81290f7-b090-45a2-9385-74a5430111f5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:38.187687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1125/2273] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:38.191687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8be52-5404-4375-8941-81cdd1d8fdb6 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:38.201447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8be52-5404-4375-8941-81cdd1d8fdb6 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:38.205995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbeb890-ee54-43af-aac5-f7bd61ee8a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:38.206629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeb890-ee54-43af-aac5-f7bd61ee8a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:38.206978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeb890-ee54-43af-aac5-f7bd61ee8a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:38.207431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeb890-ee54-43af-aac5-f7bd61ee8a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:38.208632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbeb890-ee54-43af-aac5-f7bd61ee8a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:38.211695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbeb890-ee54-43af-aac5-f7bd61ee8a2c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:38.225513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1149/2274] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:38.231197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81290f7-b090-45a2-9385-74a5430111f5 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:38.243292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81290f7-b090-45a2-9385-74a5430111f5 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:38.248248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545335bc-a8fe-457a-aa5c-aecc6ecd70d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:38.248953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545335bc-a8fe-457a-aa5c-aecc6ecd70d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:38.249236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545335bc-a8fe-457a-aa5c-aecc6ecd70d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:38.249508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545335bc-a8fe-457a-aa5c-aecc6ecd70d4 admin admin] PATH_INFO: `/v3/projects/9955be925a854d13be4e8a55589e6f4e/users/b9edeb4401274a77ab9a7391bf02cbd1/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:38.264337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545335bc-a8fe-457a-aa5c-aecc6ecd70d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9955be925a854d13be4e8a55589e6f4e, user_id=b9edeb4401274a77ab9a7391bf02cbd1, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:38.267037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545335bc-a8fe-457a-aa5c-aecc6ecd70d4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:38.281626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1126/2275] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:38 2022] PUT /identity/v3/projects/9955be925a854d13be4e8a55589e6f4e/users/b9edeb4401274a77ab9a7391bf02cbd1/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:38.287260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787867b7-306a-446e-95d8-2e998d0f9396 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:38.287551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787867b7-306a-446e-95d8-2e998d0f9396 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:38.287824 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787867b7-306a-446e-95d8-2e998d0f9396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:38.308094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-787867b7-306a-446e-95d8-2e998d0f9396 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:38.309295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-787867b7-306a-446e-95d8-2e998d0f9396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:38.367518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1150/2276] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:38.381353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545335bc-a8fe-457a-aa5c-aecc6ecd70d4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:38.383092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-545335bc-a8fe-457a-aa5c-aecc6ecd70d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:38.443874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545335bc-a8fe-457a-aa5c-aecc6ecd70d4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:38.447552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e67e9-3168-4bb3-a293-a7b08f321f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:38.448172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e67e9-3168-4bb3-a293-a7b08f321f9f service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:38.448483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e67e9-3168-4bb3-a293-a7b08f321f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:38.448759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e67e9-3168-4bb3-a293-a7b08f321f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:38.461730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e67e9-3168-4bb3-a293-a7b08f321f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:38.464590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e67e9-3168-4bb3-a293-a7b08f321f9f service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:38.476274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1127/2277] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:43.311057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c9602-b88b-4eea-99aa-ec09893e60ae None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:43.311550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c9602-b88b-4eea-99aa-ec09893e60ae None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:43.311629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c9602-b88b-4eea-99aa-ec09893e60ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:43.319316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:43.343927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e79c9602-b88b-4eea-99aa-ec09893e60ae None None] MFA Rules not processed for user `b9edeb4401274a77ab9a7391bf02cbd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:43.344859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e79c9602-b88b-4eea-99aa-ec09893e60ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:43.442703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1151/2278] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:43.447136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e67e9-3168-4bb3-a293-a7b08f321f9f service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:43.457170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e67e9-3168-4bb3-a293-a7b08f321f9f service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:43.461678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355920c-4f2a-482c-b7d7-70d38f00b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:43.462293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355920c-4f2a-482c-b7d7-70d38f00b4ec admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:43.463080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355920c-4f2a-482c-b7d7-70d38f00b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:43.463080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355920c-4f2a-482c-b7d7-70d38f00b4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:43.463542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355920c-4f2a-482c-b7d7-70d38f00b4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:43.465451 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355920c-4f2a-482c-b7d7-70d38f00b4ec admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:43.502800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1128/2279] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:10:43 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:43.506590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c9602-b88b-4eea-99aa-ec09893e60ae None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:43.528519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c9602-b88b-4eea-99aa-ec09893e60ae None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:43.617734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d219c7-4954-4213-b030-4286898c2c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:43.618547 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d219c7-4954-4213-b030-4286898c2c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:43.618823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d219c7-4954-4213-b030-4286898c2c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:43.619242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d219c7-4954-4213-b030-4286898c2c21 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:43.620107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d219c7-4954-4213-b030-4286898c2c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:43.622110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d219c7-4954-4213-b030-4286898c2c21 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:43.655596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1152/2280] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:10:43 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:10:43.657967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355920c-4f2a-482c-b7d7-70d38f00b4ec admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:43.688047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355920c-4f2a-482c-b7d7-70d38f00b4ec admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:43.702021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a7678-2e32-4c8a-acb0-ec47595dd978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:43.711898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a7678-2e32-4c8a-acb0-ec47595dd978 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:43.711898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a7678-2e32-4c8a-acb0-ec47595dd978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:43.711898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a7678-2e32-4c8a-acb0-ec47595dd978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:43.712317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a7678-2e32-4c8a-acb0-ec47595dd978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:43.717053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a7678-2e32-4c8a-acb0-ec47595dd978 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:43.733286 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1129/2281] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:43.737655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d219c7-4954-4213-b030-4286898c2c21 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:43.753813 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d219c7-4954-4213-b030-4286898c2c21 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:43.759565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b668-acda-4396-8965-14d0b697a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:43.760248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b668-acda-4396-8965-14d0b697a956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:43.760521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b668-acda-4396-8965-14d0b697a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:43.760791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b668-acda-4396-8965-14d0b697a956 admin admin] PATH_INFO: `/v3/projects/4bf41878f0bf47a2b608521f4df9c3a4/users/667f281e9b4748b89e91e41d123e568a/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:43.807687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53b668-acda-4396-8965-14d0b697a956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf41878f0bf47a2b608521f4df9c3a4, user_id=667f281e9b4748b89e91e41d123e568a, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:43.810915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53b668-acda-4396-8965-14d0b697a956 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:43.838905 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1153/2282] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:43 2022] PUT /identity/v3/projects/4bf41878f0bf47a2b608521f4df9c3a4/users/667f281e9b4748b89e91e41d123e568a/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:43.842654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a7678-2e32-4c8a-acb0-ec47595dd978 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:43.855174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a7678-2e32-4c8a-acb0-ec47595dd978 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:43.930520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:43.960006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55687bda-bdc4-456f-a3d2-93100bafaf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:43.960638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55687bda-bdc4-456f-a3d2-93100bafaf4e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:43.961093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55687bda-bdc4-456f-a3d2-93100bafaf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:43.961379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55687bda-bdc4-456f-a3d2-93100bafaf4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:43.962086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55687bda-bdc4-456f-a3d2-93100bafaf4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:43.963759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55687bda-bdc4-456f-a3d2-93100bafaf4e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:43.976640 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1130/2283] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:10:43.981296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b668-acda-4396-8965-14d0b697a956 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:44.007844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b668-acda-4396-8965-14d0b697a956 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:44.014278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d46ac-ff9e-4cc5-b65c-3d586db564d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:44.014985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d46ac-ff9e-4cc5-b65c-3d586db564d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:44.015417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d46ac-ff9e-4cc5-b65c-3d586db564d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:44.015698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d46ac-ff9e-4cc5-b65c-3d586db564d1 admin admin] PATH_INFO: `/v3/projects/4bf41878f0bf47a2b608521f4df9c3a4/users/667f281e9b4748b89e91e41d123e568a/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:44.019102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d46ac-ff9e-4cc5-b65c-3d586db564d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf41878f0bf47a2b608521f4df9c3a4, user_id=667f281e9b4748b89e91e41d123e568a, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:44.022588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d46ac-ff9e-4cc5-b65c-3d586db564d1 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:44.034975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1154/2284] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:10:43 2022] PUT /identity/v3/projects/4bf41878f0bf47a2b608521f4df9c3a4/users/667f281e9b4748b89e91e41d123e568a/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:10:50.098198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282bd79-65f9-49a4-be58-ccbe2ae98324 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:50.099376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282bd79-65f9-49a4-be58-ccbe2ae98324 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:50.099376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282bd79-65f9-49a4-be58-ccbe2ae98324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:50.134703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3282bd79-65f9-49a4-be58-ccbe2ae98324 None None] MFA Rules not processed for user `667f281e9b4748b89e91e41d123e568a`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:50.136600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3282bd79-65f9-49a4-be58-ccbe2ae98324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:50.225406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1131/2285] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:50.240425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d46ac-ff9e-4cc5-b65c-3d586db564d1 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:50.242159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f32d46ac-ff9e-4cc5-b65c-3d586db564d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:50.289551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:50.317550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d46ac-ff9e-4cc5-b65c-3d586db564d1 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:50.322991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f8842-3490-4214-82e3-796b12751960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:50.323603 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f8842-3490-4214-82e3-796b12751960 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:50.323878 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f8842-3490-4214-82e3-796b12751960 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:50.324146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f8842-3490-4214-82e3-796b12751960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:50.380897 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f8842-3490-4214-82e3-796b12751960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:50.382544 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f8842-3490-4214-82e3-796b12751960 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:50.395500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1155/2286] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:10:52.073609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731f2f5-a549-4d77-8e81-037242dd6871 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:52.074063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731f2f5-a549-4d77-8e81-037242dd6871 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:52.074181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731f2f5-a549-4d77-8e81-037242dd6871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:52.095475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b731f2f5-a549-4d77-8e81-037242dd6871 None None] MFA Rules not processed for user `b9edeb4401274a77ab9a7391bf02cbd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:10:52.096665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b731f2f5-a549-4d77-8e81-037242dd6871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:52.106352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1132/2287] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:10:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:10:54.193683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f8842-3490-4214-82e3-796b12751960 service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:10:54.195185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-031f8842-3490-4214-82e3-796b12751960 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:54.254124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f8842-3490-4214-82e3-796b12751960 service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:10:54.257819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bbe7e-b0a4-4401-928e-9f0f16de3638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:10:54.258430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bbe7e-b0a4-4401-928e-9f0f16de3638 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:10:54.258744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bbe7e-b0a4-4401-928e-9f0f16de3638 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:10:54.259018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bbe7e-b0a4-4401-928e-9f0f16de3638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:10:54.260753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f98bbe7e-b0a4-4401-928e-9f0f16de3638 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:10:54.322883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bbe7e-b0a4-4401-928e-9f0f16de3638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:10:54.324327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bbe7e-b0a4-4401-928e-9f0f16de3638 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:10:54.334505 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1156/2288] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:10:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:00.613598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731f2f5-a549-4d77-8e81-037242dd6871 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:00.616297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b731f2f5-a549-4d77-8e81-037242dd6871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:00.689837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731f2f5-a549-4d77-8e81-037242dd6871 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:00.694425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:00.695100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:00.695382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:00.695661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] PATH_INFO: `/v3/users/a7ac6b31657b46e69cdcba28221213e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:00.696836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ac6b31657b46e69cdcba28221213e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:00.699001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:00.753158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ac6b31657b46e69cdcba28221213e7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:00.753832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ac6b31657b46e69cdcba28221213e7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:00.761420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ac6b31657b46e69cdcba28221213e7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:00.766238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:00.777346 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ac6b31657b46e69cdcba28221213e7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:00.778063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ac6b31657b46e69cdcba28221213e7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:00.791359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1133/2289] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:11:00 2022] DELETE /identity/v3/users/a7ac6b31657b46e69cdcba28221213e7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:00.796238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e24e-edca-4c17-8a8c-3ed9e733c844 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:00.796709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e24e-edca-4c17-8a8c-3ed9e733c844 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:00.796825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e24e-edca-4c17-8a8c-3ed9e733c844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:00.818252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-fce6e24e-edca-4c17-8a8c-3ed9e733c844 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:00.819473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fce6e24e-edca-4c17-8a8c-3ed9e733c844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:00.845208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:00.879076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1157/2290] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:00.888600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:00.890003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:00.950023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a88a40-24ae-4069-9158-b7e3c81c69e8 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:00.953744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781ecf0-40ba-419a-866f-0ce972d11f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:00.954364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781ecf0-40ba-419a-866f-0ce972d11f14 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:00.954808 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781ecf0-40ba-419a-866f-0ce972d11f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:00.955086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781ecf0-40ba-419a-866f-0ce972d11f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:00.965811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781ecf0-40ba-419a-866f-0ce972d11f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:00.967371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781ecf0-40ba-419a-866f-0ce972d11f14 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:00.980823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1134/2291] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:01.273623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6e24e-edca-4c17-8a8c-3ed9e733c844 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:01.275597 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fce6e24e-edca-4c17-8a8c-3ed9e733c844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:01.303512 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6e24e-edca-4c17-8a8c-3ed9e733c844 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:01.308707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:01.311501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:01.311501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:01.314853 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] PATH_INFO: `/v3/projects/c783e533aa934e839235757bff619ea5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:01.315859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c783e533aa934e839235757bff619ea5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:01.317830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:01.380452 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c783e533aa934e839235757bff619ea5', 'request_id': 'req-4668fa0c-4569-4c5d-aa01-62d36d1366f6'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:01.390175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c783e533aa934e839235757bff619ea5', 'request_id': 'req-4668fa0c-4569-4c5d-aa01-62d36d1366f6'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:01.398815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c783e533aa934e839235757bff619ea5', 'request_id': 'req-4668fa0c-4569-4c5d-aa01-62d36d1366f6'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:01.412574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] The token cache is being invalidate because project c783e533aa934e839235757bff619ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:11:01.412855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:01.415879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:01.417446 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1158/2292] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:11:01 2022] DELETE /identity/v3/projects/c783e533aa934e839235757bff619ea5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:03.121642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ff80-64c2-4492-9e5c-757c5c2cc0c6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:03.122159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ff80-64c2-4492-9e5c-757c5c2cc0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:03.122539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ff80-64c2-4492-9e5c-757c5c2cc0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:03.143809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e084ff80-64c2-4492-9e5c-757c5c2cc0c6 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:03.145035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e084ff80-64c2-4492-9e5c-757c5c2cc0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:03.211277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1135/2293] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:11:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:03.224039 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:03.225477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:03.299059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668fa0c-4569-4c5d-aa01-62d36d1366f6 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:03.304694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b0b04-3c46-4aff-948e-5c252f86a8f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:03.305305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b0b04-3c46-4aff-948e-5c252f86a8f3 service swift] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:03.305583 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b0b04-3c46-4aff-948e-5c252f86a8f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:03.305853 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b0b04-3c46-4aff-948e-5c252f86a8f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:03.314584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b0b04-3c46-4aff-948e-5c252f86a8f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:03.316210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b0b04-3c46-4aff-948e-5c252f86a8f3 service swift] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:03.325176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1159/2294] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:11:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 02:11:13.204151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=2,keystone:SELECT=60 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:13.322388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:15.128591 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88633c-4a54-4b9a-acf8-e4c6a48707dd None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:15.129590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88633c-4a54-4b9a-acf8-e4c6a48707dd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:15.130048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88633c-4a54-4b9a-acf8-e4c6a48707dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:15.155824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7c88633c-4a54-4b9a-acf8-e4c6a48707dd None None] MFA Rules not processed for user `c88a4ae446ac43b48ee778344caec88c`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:15.157203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7c88633c-4a54-4b9a-acf8-e4c6a48707dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:15.267738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1136/2295] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:16.962711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462300ec-30c5-42e5-b86d-8d873dec0bd0 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:16.963715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462300ec-30c5-42e5-b86d-8d873dec0bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:16.964019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462300ec-30c5-42e5-b86d-8d873dec0bd0 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:16.965956 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1160/2296] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:11:17.000120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de531e-799f-48cf-8d82-439cc42bc7f2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:17.000697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de531e-799f-48cf-8d82-439cc42bc7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:17.000697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de531e-799f-48cf-8d82-439cc42bc7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:17.024939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-43de531e-799f-48cf-8d82-439cc42bc7f2 None None] MFA Rules not processed for user `e041d38c69cd4626898bc1412f5ed1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:17.026461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-43de531e-799f-48cf-8d82-439cc42bc7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:17.141823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1137/2297] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:11:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:11:17.170345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462300ec-30c5-42e5-b86d-8d873dec0bd0 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:17.174533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-462300ec-30c5-42e5-b86d-8d873dec0bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:17.215745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462300ec-30c5-42e5-b86d-8d873dec0bd0 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:17.228385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2467858-4f5f-46e5-a42f-188bba5f4078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:17.229450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2467858-4f5f-46e5-a42f-188bba5f4078 service placement] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:17.229894 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2467858-4f5f-46e5-a42f-188bba5f4078 service placement] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:17.230326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2467858-4f5f-46e5-a42f-188bba5f4078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:17.242811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2467858-4f5f-46e5-a42f-188bba5f4078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:17.245338 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2467858-4f5f-46e5-a42f-188bba5f4078 service placement] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:17.269116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1161/2298] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:11:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:18.104323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de531e-799f-48cf-8d82-439cc42bc7f2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:18.107216 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-43de531e-799f-48cf-8d82-439cc42bc7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:18.244946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de531e-799f-48cf-8d82-439cc42bc7f2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:18.251062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:18.251804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:18.252244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:18.252585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] PATH_INFO: `/v3/users/41d675ced8f748189098fd8c58506534` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:18.254009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d675ced8f748189098fd8c58506534)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:18.256217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:18.340956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:18.344025 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d675ced8f748189098fd8c58506534'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:18.345008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d675ced8f748189098fd8c58506534'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:18.363904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d675ced8f748189098fd8c58506534'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:18.394340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d675ced8f748189098fd8c58506534'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:18.399359 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d675ced8f748189098fd8c58506534'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:18.421542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1138/2299] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:11:18 2022] DELETE /identity/v3/users/41d675ced8f748189098fd8c58506534 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:18.659569 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2467858-4f5f-46e5-a42f-188bba5f4078 service placement] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:18.677733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2467858-4f5f-46e5-a42f-188bba5f4078 service placement] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:18.798432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:18.799439 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:18.799911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:18.800368 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] PATH_INFO: `/v3/projects/b6dbb5c5b87848f0baeaf8ade1b4debf` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:18.801820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6dbb5c5b87848f0baeaf8ade1b4debf)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:18.807341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:18.893145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6dbb5c5b87848f0baeaf8ade1b4debf', 'request_id': 'req-d35de2a5-194f-4e85-9243-f1a03e526d86'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:18.910323 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6dbb5c5b87848f0baeaf8ade1b4debf', 'request_id': 'req-d35de2a5-194f-4e85-9243-f1a03e526d86'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:18.923630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6dbb5c5b87848f0baeaf8ade1b4debf', 'request_id': 'req-d35de2a5-194f-4e85-9243-f1a03e526d86'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:18.936761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] The token cache is being invalidate because project b6dbb5c5b87848f0baeaf8ade1b4debf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:11:18.937055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:18.937728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:18.940671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1162/2300] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:11:18 2022] DELETE /identity/v3/projects/b6dbb5c5b87848f0baeaf8ade1b4debf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:18.944260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:18.945696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:18.960578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91be0d-ee00-40c5-8f47-22862c17ed02 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:19.031719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:19.032087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:19.033130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:19.033130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] PATH_INFO: `/v3/users/f9cd0de007174a40b6abc404bedd25c9` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:19.034140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9cd0de007174a40b6abc404bedd25c9)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:19.036794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:19.116316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9cd0de007174a40b6abc404bedd25c9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:19.118707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9cd0de007174a40b6abc404bedd25c9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:19.130366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9cd0de007174a40b6abc404bedd25c9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:19.148704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9cd0de007174a40b6abc404bedd25c9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:19.149971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-240da89a-58c7-409a-9890-b874dba81fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9cd0de007174a40b6abc404bedd25c9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:19.166495 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1139/2301] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:11:18 2022] DELETE /identity/v3/users/f9cd0de007174a40b6abc404bedd25c9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:19.504934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:19.507204 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:19.541597 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35de2a5-194f-4e85-9243-f1a03e526d86 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:19.641408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:19.645152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:19.645152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:19.645152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] PATH_INFO: `/v3/projects/81e25768b7bb40758c28ed6b3bbf44e4` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:19.647263 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e25768b7bb40758c28ed6b3bbf44e4)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:19.649519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:19.692651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:19.732508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e25768b7bb40758c28ed6b3bbf44e4', 'request_id': 'req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:19.763773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e25768b7bb40758c28ed6b3bbf44e4', 'request_id': 'req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:19.784125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e25768b7bb40758c28ed6b3bbf44e4', 'request_id': 'req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:19.816455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] The token cache is being invalidate because project 81e25768b7bb40758c28ed6b3bbf44e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:11:19.816907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:19.817880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f63ab4d6-9c8b-480c-a48f-cdce253b3f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:19.824405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1163/2302] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:11:19 2022] DELETE /identity/v3/projects/81e25768b7bb40758c28ed6b3bbf44e4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:19.829205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99cd71-828f-4f42-8785-ce28b2d5e943 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:19.829494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99cd71-828f-4f42-8785-ce28b2d5e943 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:19.829765 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99cd71-828f-4f42-8785-ce28b2d5e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:19.865697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ec99cd71-828f-4f42-8785-ce28b2d5e943 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:19.867812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ec99cd71-828f-4f42-8785-ce28b2d5e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:19.932863 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:19.971427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1140/2303] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:19.973126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835f68-9880-457c-822c-b09111813847 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:19.973319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835f68-9880-457c-822c-b09111813847 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:19.973606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835f68-9880-457c-822c-b09111813847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:20.002059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-89835f68-9880-457c-822c-b09111813847 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:20.003335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-89835f68-9880-457c-822c-b09111813847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:20.029024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1164/2304] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:20.029997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99cd71-828f-4f42-8785-ce28b2d5e943 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:20.042769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99cd71-828f-4f42-8785-ce28b2d5e943 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:20.051654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7122ec-a767-43f9-9072-0bfde1f23834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:20.052318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7122ec-a767-43f9-9072-0bfde1f23834 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:20.052676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7122ec-a767-43f9-9072-0bfde1f23834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:20.053059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7122ec-a767-43f9-9072-0bfde1f23834 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:20.053851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7122ec-a767-43f9-9072-0bfde1f23834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:11:20.054253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7122ec-a767-43f9-9072-0bfde1f23834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:20.056157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7122ec-a767-43f9-9072-0bfde1f23834 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:20.090534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1141/2305] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:11:20.094393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89835f68-9880-457c-822c-b09111813847 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:20.110376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89835f68-9880-457c-822c-b09111813847 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:20.115502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7138cd5-4495-4e34-beaa-62e03dd4f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:20.116132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7138cd5-4495-4e34-beaa-62e03dd4f659 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:20.116412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7138cd5-4495-4e34-beaa-62e03dd4f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:20.116704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7138cd5-4495-4e34-beaa-62e03dd4f659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:20.117581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7138cd5-4495-4e34-beaa-62e03dd4f659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:20.121772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7138cd5-4495-4e34-beaa-62e03dd4f659 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:20.175022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1165/2306] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:11:20 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:11:20.179035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7122ec-a767-43f9-9072-0bfde1f23834 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:20.196007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7122ec-a767-43f9-9072-0bfde1f23834 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:20.273606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25862112-cddb-4f67-b055-b9d46e15b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:20.274646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862112-cddb-4f67-b055-b9d46e15b0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:20.275128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862112-cddb-4f67-b055-b9d46e15b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:20.276091 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862112-cddb-4f67-b055-b9d46e15b0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:20.277195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25862112-cddb-4f67-b055-b9d46e15b0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:20.279457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25862112-cddb-4f67-b055-b9d46e15b0c5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:20.310980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1142/2307] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:11:20 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:11:20.315164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7138cd5-4495-4e34-beaa-62e03dd4f659 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:20.347349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7138cd5-4495-4e34-beaa-62e03dd4f659 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:20.371508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d073cf-2faf-439d-887d-f312b2ed598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:20.372166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d073cf-2faf-439d-887d-f312b2ed598e admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:20.372446 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d073cf-2faf-439d-887d-f312b2ed598e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:20.372717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d073cf-2faf-439d-887d-f312b2ed598e admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:20.373442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d073cf-2faf-439d-887d-f312b2ed598e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:20.378971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d073cf-2faf-439d-887d-f312b2ed598e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:20.409375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1166/2308] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:11:20.413469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25862112-cddb-4f67-b055-b9d46e15b0c5 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:20.430090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25862112-cddb-4f67-b055-b9d46e15b0c5 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:20.441906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705c1a4-38d2-4d66-91d4-bc6bd7b37e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:20.442840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705c1a4-38d2-4d66-91d4-bc6bd7b37e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:20.443426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705c1a4-38d2-4d66-91d4-bc6bd7b37e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:20.444561 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705c1a4-38d2-4d66-91d4-bc6bd7b37e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:20.445635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705c1a4-38d2-4d66-91d4-bc6bd7b37e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:20.447860 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705c1a4-38d2-4d66-91d4-bc6bd7b37e62 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:20.469433 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1143/2309] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:11:20.473622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d073cf-2faf-439d-887d-f312b2ed598e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:20.485643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d073cf-2faf-439d-887d-f312b2ed598e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:20.493035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77b12d-9d38-4e19-84fa-75e6697d8e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:20.493835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77b12d-9d38-4e19-84fa-75e6697d8e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:20.494267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77b12d-9d38-4e19-84fa-75e6697d8e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:20.498135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77b12d-9d38-4e19-84fa-75e6697d8e66 admin admin] PATH_INFO: `/v3/projects/989b1e3cb9cb4b9d8011337603ecc7c6/users/bbe53151a02f4e18931d8621bcbb9f20/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:20.526302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77b12d-9d38-4e19-84fa-75e6697d8e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989b1e3cb9cb4b9d8011337603ecc7c6, user_id=bbe53151a02f4e18931d8621bcbb9f20, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:20.530587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77b12d-9d38-4e19-84fa-75e6697d8e66 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:20.557247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1167/2310] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:11:20 2022] PUT /identity/v3/projects/989b1e3cb9cb4b9d8011337603ecc7c6/users/bbe53151a02f4e18931d8621bcbb9f20/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:20.567700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517d4b9-4407-4140-9dd7-32bbcaa23881 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:20.568004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517d4b9-4407-4140-9dd7-32bbcaa23881 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:20.568292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517d4b9-4407-4140-9dd7-32bbcaa23881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:20.629957 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4517d4b9-4407-4140-9dd7-32bbcaa23881 None None] MFA Rules not processed for user `bbe53151a02f4e18931d8621bcbb9f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:20.631585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4517d4b9-4407-4140-9dd7-32bbcaa23881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:20.769610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1144/2311] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:20.771173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77b12d-9d38-4e19-84fa-75e6697d8e66 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:20.774687 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fc77b12d-9d38-4e19-84fa-75e6697d8e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:20.886794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77b12d-9d38-4e19-84fa-75e6697d8e66 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:20.892982 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f128e1-da7d-4cf8-b6d2-4d2a4b86aff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:20.893612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f128e1-da7d-4cf8-b6d2-4d2a4b86aff5 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:20.893885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f128e1-da7d-4cf8-b6d2-4d2a4b86aff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:20.894158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f128e1-da7d-4cf8-b6d2-4d2a4b86aff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:20.920999 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f128e1-da7d-4cf8-b6d2-4d2a4b86aff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:20.922947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f128e1-da7d-4cf8-b6d2-4d2a4b86aff5 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:20.945977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1168/2312] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:11:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:20.972896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517d4b9-4407-4140-9dd7-32bbcaa23881 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:21.032800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:21.169028 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517d4b9-4407-4140-9dd7-32bbcaa23881 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:21.208135 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:21.208893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:21.209704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:21.209986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] PATH_INFO: `/v3/users/bbe53151a02f4e18931d8621bcbb9f20` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:21.218824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe53151a02f4e18931d8621bcbb9f20)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:21.226348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:21.329786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe53151a02f4e18931d8621bcbb9f20'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:21.330650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe53151a02f4e18931d8621bcbb9f20'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:21.345110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe53151a02f4e18931d8621bcbb9f20'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:21.390343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe53151a02f4e18931d8621bcbb9f20'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:21.391211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe53151a02f4e18931d8621bcbb9f20'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:21.411100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1145/2313] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:11:20 2022] DELETE /identity/v3/users/bbe53151a02f4e18931d8621bcbb9f20 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:21.415531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7b85b-71e7-469e-ab33-fb51b268eb1a None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:21.415793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7b85b-71e7-469e-ab33-fb51b268eb1a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:21.416205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7b85b-71e7-469e-ab33-fb51b268eb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:21.440343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-93f7b85b-71e7-469e-ab33-fb51b268eb1a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:21.441645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-93f7b85b-71e7-469e-ab33-fb51b268eb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:21.492895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:21.523808 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1169/2314] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:21.531926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:21.533371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:21.619934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66c2b-0e97-436d-82a0-1e4f55aed21b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:21.624296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d9947-ffd7-4ceb-98fa-c9ecfd58a01f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:21.625049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9947-ffd7-4ceb-98fa-c9ecfd58a01f service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:21.625463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9947-ffd7-4ceb-98fa-c9ecfd58a01f service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:21.625826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9947-ffd7-4ceb-98fa-c9ecfd58a01f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:21.638726 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d9947-ffd7-4ceb-98fa-c9ecfd58a01f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:21.640290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d9947-ffd7-4ceb-98fa-c9ecfd58a01f service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:21.653252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1146/2315] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:22.022332 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7b85b-71e7-469e-ab33-fb51b268eb1a None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:22.029388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-93f7b85b-71e7-469e-ab33-fb51b268eb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:22.045673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7b85b-71e7-469e-ab33-fb51b268eb1a None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:22.050799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:22.051613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.052024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.052388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] PATH_INFO: `/v3/projects/989b1e3cb9cb4b9d8011337603ecc7c6` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.057169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989b1e3cb9cb4b9d8011337603ecc7c6)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:22.059218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:22.155344 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989b1e3cb9cb4b9d8011337603ecc7c6', 'request_id': 'req-1063308f-629d-4327-914d-649e5c432657'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:22.167523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989b1e3cb9cb4b9d8011337603ecc7c6', 'request_id': 'req-1063308f-629d-4327-914d-649e5c432657'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:22.182889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989b1e3cb9cb4b9d8011337603ecc7c6', 'request_id': 'req-1063308f-629d-4327-914d-649e5c432657'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:22.195370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] The token cache is being invalidate because project 989b1e3cb9cb4b9d8011337603ecc7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:11:22.195706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:22.196432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-1063308f-629d-4327-914d-649e5c432657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:22.198521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1170/2316] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:11:22 2022] DELETE /identity/v3/projects/989b1e3cb9cb4b9d8011337603ecc7c6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:22.203215 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3149cf5-60d2-4355-9075-1f9f4ae7fbc3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.203584 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3149cf5-60d2-4355-9075-1f9f4ae7fbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.203888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3149cf5-60d2-4355-9075-1f9f4ae7fbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.226835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e3149cf5-60d2-4355-9075-1f9f4ae7fbc3 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:22.228095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e3149cf5-60d2-4355-9075-1f9f4ae7fbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:22.286936 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:22.304597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1147/2317] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:22.308154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541bab1-b6d5-4943-a5fa-c6fa2b938deb None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.308482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541bab1-b6d5-4943-a5fa-c6fa2b938deb None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.308707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541bab1-b6d5-4943-a5fa-c6fa2b938deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.331944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9541bab1-b6d5-4943-a5fa-c6fa2b938deb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:22.333160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9541bab1-b6d5-4943-a5fa-c6fa2b938deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:22.344767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1171/2318] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:22.349350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3149cf5-60d2-4355-9075-1f9f4ae7fbc3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:22.359506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3149cf5-60d2-4355-9075-1f9f4ae7fbc3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:22.366286 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19f3e1-c640-4080-bd45-9826d13879b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:22.366960 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19f3e1-c640-4080-bd45-9826d13879b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.367238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19f3e1-c640-4080-bd45-9826d13879b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.367510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19f3e1-c640-4080-bd45-9826d13879b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.368350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19f3e1-c640-4080-bd45-9826d13879b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:11:22.368794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19f3e1-c640-4080-bd45-9826d13879b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:22.370410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19f3e1-c640-4080-bd45-9826d13879b9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:22.384735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1148/2319] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:11:22.389155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541bab1-b6d5-4943-a5fa-c6fa2b938deb None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:22.403718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541bab1-b6d5-4943-a5fa-c6fa2b938deb None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:22.410385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3c820-43e6-402b-b7e0-088bad78783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:22.411009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c820-43e6-402b-b7e0-088bad78783c admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.411291 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c820-43e6-402b-b7e0-088bad78783c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.411564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c820-43e6-402b-b7e0-088bad78783c admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.412656 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3c820-43e6-402b-b7e0-088bad78783c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:22.414663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3c820-43e6-402b-b7e0-088bad78783c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:22.450492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1172/2320] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:11:22 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:11:22.452831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19f3e1-c640-4080-bd45-9826d13879b9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:22.466184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19f3e1-c640-4080-bd45-9826d13879b9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:22.531494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab430c12-8cca-4c95-b68e-c0b1e8f32063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:22.532284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab430c12-8cca-4c95-b68e-c0b1e8f32063 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.532633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab430c12-8cca-4c95-b68e-c0b1e8f32063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.532908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab430c12-8cca-4c95-b68e-c0b1e8f32063 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.533996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab430c12-8cca-4c95-b68e-c0b1e8f32063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:22.536467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab430c12-8cca-4c95-b68e-c0b1e8f32063 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:22.564341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1149/2321] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:11:22 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:11:22.569168 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3c820-43e6-402b-b7e0-088bad78783c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:22.580095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3c820-43e6-402b-b7e0-088bad78783c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:22.587629 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6ed2f-67f4-4d33-98bf-5a8316bfb561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:22.588258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ed2f-67f4-4d33-98bf-5a8316bfb561 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.588543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ed2f-67f4-4d33-98bf-5a8316bfb561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.588947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ed2f-67f4-4d33-98bf-5a8316bfb561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.589654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6ed2f-67f4-4d33-98bf-5a8316bfb561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:22.591311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6ed2f-67f4-4d33-98bf-5a8316bfb561 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:22.602081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1173/2322] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:11:22.606312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab430c12-8cca-4c95-b68e-c0b1e8f32063 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:22.616929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab430c12-8cca-4c95-b68e-c0b1e8f32063 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:22.623499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0042a-3a3b-476c-a2c7-5b70a2418276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:22.624291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0042a-3a3b-476c-a2c7-5b70a2418276 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.624587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0042a-3a3b-476c-a2c7-5b70a2418276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.624858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0042a-3a3b-476c-a2c7-5b70a2418276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.625564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0042a-3a3b-476c-a2c7-5b70a2418276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:22.627205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0042a-3a3b-476c-a2c7-5b70a2418276 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:22.640484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1150/2323] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:11:22.644931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6ed2f-67f4-4d33-98bf-5a8316bfb561 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:22.659249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6ed2f-67f4-4d33-98bf-5a8316bfb561 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:22.665582 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d90968-fde3-4dfb-b0d3-b9dfe53296cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:22.666579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d90968-fde3-4dfb-b0d3-b9dfe53296cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.666868 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d90968-fde3-4dfb-b0d3-b9dfe53296cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.667240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d90968-fde3-4dfb-b0d3-b9dfe53296cf admin admin] PATH_INFO: `/v3/projects/804664f72d66416584e0953e91f4405c/users/520d0644f4da41238b320d8958ffa611/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.687842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d90968-fde3-4dfb-b0d3-b9dfe53296cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=804664f72d66416584e0953e91f4405c, user_id=520d0644f4da41238b320d8958ffa611, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:22.690988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d90968-fde3-4dfb-b0d3-b9dfe53296cf admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:22.708912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1174/2324] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:11:22 2022] PUT /identity/v3/projects/804664f72d66416584e0953e91f4405c/users/520d0644f4da41238b320d8958ffa611/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:22.719352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe6f5-d890-4499-80a6-3c13e0046ad7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.719633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe6f5-d890-4499-80a6-3c13e0046ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.719904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe6f5-d890-4499-80a6-3c13e0046ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.753719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-dc7fe6f5-d890-4499-80a6-3c13e0046ad7 None None] MFA Rules not processed for user `520d0644f4da41238b320d8958ffa611`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:22.755023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dc7fe6f5-d890-4499-80a6-3c13e0046ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:22.835652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1151/2325] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:22.847431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d90968-fde3-4dfb-b0d3-b9dfe53296cf admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:22.849654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-00d90968-fde3-4dfb-b0d3-b9dfe53296cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:22.921833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d90968-fde3-4dfb-b0d3-b9dfe53296cf admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:22.925925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b18ffe-5faf-49af-a44b-8e3c26bfa0a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece4e0b16a9441b5ba14bbc8ff1c632c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:22.926575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b18ffe-5faf-49af-a44b-8e3c26bfa0a0 service glance] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:22.926870 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b18ffe-5faf-49af-a44b-8e3c26bfa0a0 service glance] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:22.927145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b18ffe-5faf-49af-a44b-8e3c26bfa0a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:22.938123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b18ffe-5faf-49af-a44b-8e3c26bfa0a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:22.939917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b18ffe-5faf-49af-a44b-8e3c26bfa0a0 service glance] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:22.950386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1175/2326] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:11:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:28.327291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2780a5-8a30-40c2-886b-344513858601 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:28.327833 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2780a5-8a30-40c2-886b-344513858601 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:28.327994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2780a5-8a30-40c2-886b-344513858601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:28.347258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7f2780a5-8a30-40c2-886b-344513858601 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:28.350545 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7f2780a5-8a30-40c2-886b-344513858601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:28.397898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:28.409436 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1152/2327] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jul 28 02:11:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:28.422037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b18ffe-5faf-49af-a44b-8e3c26bfa0a0 service glance] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:28.423446 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-63b18ffe-5faf-49af-a44b-8e3c26bfa0a0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:28.434867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:28.498974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b18ffe-5faf-49af-a44b-8e3c26bfa0a0 service glance] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:28.503949 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5444d8f-b91e-4444-a671-a755a0449bfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:28.504552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5444d8f-b91e-4444-a671-a755a0449bfd service swift] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:28.504827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5444d8f-b91e-4444-a671-a755a0449bfd service swift] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:28.505096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5444d8f-b91e-4444-a671-a755a0449bfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:28.514314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5444d8f-b91e-4444-a671-a755a0449bfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:28.515965 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5444d8f-b91e-4444-a671-a755a0449bfd service swift] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:28.524937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1176/2328] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:11:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:11:30.467711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2780a5-8a30-40c2-886b-344513858601 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:30.469239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7f2780a5-8a30-40c2-886b-344513858601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:30.539065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2780a5-8a30-40c2-886b-344513858601 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:30.543573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:30.544210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:30.544482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:30.544749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] PATH_INFO: `/v3/users/b90cb62ab0a643ea939e00f81fea1b96` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:30.545930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90cb62ab0a643ea939e00f81fea1b96)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:30.547856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:30.598943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90cb62ab0a643ea939e00f81fea1b96'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:30.600202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90cb62ab0a643ea939e00f81fea1b96'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:30.608073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90cb62ab0a643ea939e00f81fea1b96'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:30.622190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90cb62ab0a643ea939e00f81fea1b96'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:30.622914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3b38c895-010a-418c-ab60-d149b64447bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90cb62ab0a643ea939e00f81fea1b96'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:30.635385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1153/2329] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:11:30 2022] DELETE /identity/v3/users/b90cb62ab0a643ea939e00f81fea1b96 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:30.828245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5444d8f-b91e-4444-a671-a755a0449bfd service swift] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:30.841894 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5444d8f-b91e-4444-a671-a755a0449bfd service swift] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:30.915970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:30.916566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:30.916848 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:30.917123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] PATH_INFO: `/v3/projects/dc72d1ffc73348e7bd280f5b8ab78c22` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:30.918289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc72d1ffc73348e7bd280f5b8ab78c22)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:30.920244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:30.969476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc72d1ffc73348e7bd280f5b8ab78c22', 'request_id': 'req-175420ef-ec6a-4b0b-b485-6ec52465e737'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:30.977034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc72d1ffc73348e7bd280f5b8ab78c22', 'request_id': 'req-175420ef-ec6a-4b0b-b485-6ec52465e737'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:30.983729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc72d1ffc73348e7bd280f5b8ab78c22', 'request_id': 'req-175420ef-ec6a-4b0b-b485-6ec52465e737'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:30.995195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] The token cache is being invalidate because project dc72d1ffc73348e7bd280f5b8ab78c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:11:30.995481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:30.996114 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-175420ef-ec6a-4b0b-b485-6ec52465e737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:30.997765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1177/2330] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:11:30 2022] DELETE /identity/v3/projects/dc72d1ffc73348e7bd280f5b8ab78c22 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:31.002582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278455f6-5744-4565-89e4-af65bf7c5ab0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:31.003251 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278455f6-5744-4565-89e4-af65bf7c5ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:31.003251 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278455f6-5744-4565-89e4-af65bf7c5ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:31.023692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-278455f6-5744-4565-89e4-af65bf7c5ab0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:31.024905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-278455f6-5744-4565-89e4-af65bf7c5ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:31.090530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1154/2331] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:31.098846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc19353-e3e6-43e0-9ebc-6b127b743786 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:31.099136 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc19353-e3e6-43e0-9ebc-6b127b743786 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:31.099416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc19353-e3e6-43e0-9ebc-6b127b743786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:31.121309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-dfc19353-e3e6-43e0-9ebc-6b127b743786 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:31.122565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-dfc19353-e3e6-43e0-9ebc-6b127b743786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:31.130560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1178/2332] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:31.135364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278455f6-5744-4565-89e4-af65bf7c5ab0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:31.148529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278455f6-5744-4565-89e4-af65bf7c5ab0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:31.153364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fee8a5-ea86-4482-9521-a4c75f58ec3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:31.153998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fee8a5-ea86-4482-9521-a4c75f58ec3f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:31.154280 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fee8a5-ea86-4482-9521-a4c75f58ec3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:31.154615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fee8a5-ea86-4482-9521-a4c75f58ec3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:31.155827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fee8a5-ea86-4482-9521-a4c75f58ec3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:11:31.156395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fee8a5-ea86-4482-9521-a4c75f58ec3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:31.159005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fee8a5-ea86-4482-9521-a4c75f58ec3f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:31.171732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1155/2333] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:11:31.176042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc19353-e3e6-43e0-9ebc-6b127b743786 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:31.186859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc19353-e3e6-43e0-9ebc-6b127b743786 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:31.192129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067c16f-9ad1-41fb-a987-9c87ae4895f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:31.192752 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c16f-9ad1-41fb-a987-9c87ae4895f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:31.193036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c16f-9ad1-41fb-a987-9c87ae4895f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:31.193487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c16f-9ad1-41fb-a987-9c87ae4895f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:31.194226 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067c16f-9ad1-41fb-a987-9c87ae4895f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:31.196202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067c16f-9ad1-41fb-a987-9c87ae4895f5 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:31.217823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:31.227783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1179/2334] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:11:31 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:11:31.229605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fee8a5-ea86-4482-9521-a4c75f58ec3f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:31.236232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:31.240192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fee8a5-ea86-4482-9521-a4c75f58ec3f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:31.298380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872869e-2fa8-40a7-9650-3ac953a5d2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:31.299131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872869e-2fa8-40a7-9650-3ac953a5d2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:31.299296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872869e-2fa8-40a7-9650-3ac953a5d2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:31.299563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872869e-2fa8-40a7-9650-3ac953a5d2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:31.300224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872869e-2fa8-40a7-9650-3ac953a5d2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:31.302146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872869e-2fa8-40a7-9650-3ac953a5d2c4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:31.324939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1156/2335] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:11:31 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:11:31.329035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067c16f-9ad1-41fb-a987-9c87ae4895f5 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:31.339841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067c16f-9ad1-41fb-a987-9c87ae4895f5 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:31.344473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34e715-6110-4276-a8d7-78d8ebd2bafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:31.345102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34e715-6110-4276-a8d7-78d8ebd2bafb admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:31.345371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34e715-6110-4276-a8d7-78d8ebd2bafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:31.345773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34e715-6110-4276-a8d7-78d8ebd2bafb admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:31.346340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34e715-6110-4276-a8d7-78d8ebd2bafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:31.347980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34e715-6110-4276-a8d7-78d8ebd2bafb admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:31.358955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1180/2336] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:11:31.363216 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872869e-2fa8-40a7-9650-3ac953a5d2c4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:31.374980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872869e-2fa8-40a7-9650-3ac953a5d2c4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:31.379623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac5f4f-50fc-4543-aa6f-64e612faf13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:31.380230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5f4f-50fc-4543-aa6f-64e612faf13d admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:31.380512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5f4f-50fc-4543-aa6f-64e612faf13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:31.380784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5f4f-50fc-4543-aa6f-64e612faf13d admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:31.381483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac5f4f-50fc-4543-aa6f-64e612faf13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:31.383127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac5f4f-50fc-4543-aa6f-64e612faf13d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:31.399839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1157/2337] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:11:31.401132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34e715-6110-4276-a8d7-78d8ebd2bafb admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:31.411182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34e715-6110-4276-a8d7-78d8ebd2bafb admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:31.416369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4d19-6751-4fe7-8a83-549b01d39441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:31.417018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4d19-6751-4fe7-8a83-549b01d39441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:31.417294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4d19-6751-4fe7-8a83-549b01d39441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:31.417568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4d19-6751-4fe7-8a83-549b01d39441 admin admin] PATH_INFO: `/v3/projects/4ca5c1dd1de945ceaa94015f9837fed2/users/637d43f9b56640c98af67c7b47159bb2/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:31.434705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a4d19-6751-4fe7-8a83-549b01d39441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca5c1dd1de945ceaa94015f9837fed2, user_id=637d43f9b56640c98af67c7b47159bb2, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:31.437381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a4d19-6751-4fe7-8a83-549b01d39441 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:31.451349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1181/2338] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:11:31 2022] PUT /identity/v3/projects/4ca5c1dd1de945ceaa94015f9837fed2/users/637d43f9b56640c98af67c7b47159bb2/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:31.461600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f666-fd3e-47da-b39a-4bee3159094d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:31.461931 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f666-fd3e-47da-b39a-4bee3159094d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:31.462366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f666-fd3e-47da-b39a-4bee3159094d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:31.496079 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a919f666-fd3e-47da-b39a-4bee3159094d None None] MFA Rules not processed for user `637d43f9b56640c98af67c7b47159bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:31.497413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a919f666-fd3e-47da-b39a-4bee3159094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:31.565613 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1158/2339] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:31.577764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4d19-6751-4fe7-8a83-549b01d39441 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:31.579470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2f0a4d19-6751-4fe7-8a83-549b01d39441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:31.637658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4d19-6751-4fe7-8a83-549b01d39441 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:31.641278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3df3c-5308-4583-92b8-1f658ab4763d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece4e0b16a9441b5ba14bbc8ff1c632c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:31.641889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3df3c-5308-4583-92b8-1f658ab4763d service glance] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:31.642164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3df3c-5308-4583-92b8-1f658ab4763d service glance] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:31.642446 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3df3c-5308-4583-92b8-1f658ab4763d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:31.650926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3df3c-5308-4583-92b8-1f658ab4763d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:31.652404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3df3c-5308-4583-92b8-1f658ab4763d service glance] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:31.661767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1182/2340] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:11:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:41.562251 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=64,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:41.657515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:41.776283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919f666-fd3e-47da-b39a-4bee3159094d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:41.777677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a919f666-fd3e-47da-b39a-4bee3159094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:41.846327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919f666-fd3e-47da-b39a-4bee3159094d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:41.850853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc404984-0b6a-4c8f-96e5-a7df6b645f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:41.851482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404984-0b6a-4c8f-96e5-a7df6b645f07 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:41.851758 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404984-0b6a-4c8f-96e5-a7df6b645f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:41.852029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404984-0b6a-4c8f-96e5-a7df6b645f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:41.853935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dc404984-0b6a-4c8f-96e5-a7df6b645f07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:41.932131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc404984-0b6a-4c8f-96e5-a7df6b645f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:41.933610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc404984-0b6a-4c8f-96e5-a7df6b645f07 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:41.944492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1159/2341] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:11:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:51.451157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3df3c-5308-4583-92b8-1f658ab4763d service glance] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:51.452579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b0f3df3c-5308-4583-92b8-1f658ab4763d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:51.517955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3df3c-5308-4583-92b8-1f658ab4763d service glance] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:51.522476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:51.523106 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:51.523382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:51.523653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] PATH_INFO: `/v3/users/520d0644f4da41238b320d8958ffa611` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:51.524832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520d0644f4da41238b320d8958ffa611)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:51.527385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:51.573514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520d0644f4da41238b320d8958ffa611'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:51.574167 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520d0644f4da41238b320d8958ffa611'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:51.581731 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520d0644f4da41238b320d8958ffa611'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:51.595735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520d0644f4da41238b320d8958ffa611'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:51.596485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520d0644f4da41238b320d8958ffa611'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:51.609812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1183/2342] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:11:51 2022] DELETE /identity/v3/users/520d0644f4da41238b320d8958ffa611 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:51.614181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d90f2c-74b7-413d-91b0-b455d4f36f10 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:51.614682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d90f2c-74b7-413d-91b0-b455d4f36f10 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:51.614803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d90f2c-74b7-413d-91b0-b455d4f36f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:51.635513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d0d90f2c-74b7-413d-91b0-b455d4f36f10 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:51.636654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d0d90f2c-74b7-413d-91b0-b455d4f36f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:51.701435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1160/2343] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:51.707878 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:51.709298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:51.765854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62531a4-fa37-4f44-8cd5-9b8972648145 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:51.769486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520a948-5c36-437d-a503-75bd9c74aa53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:51.770102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520a948-5c36-437d-a503-75bd9c74aa53 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:51.770383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520a948-5c36-437d-a503-75bd9c74aa53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:51.770688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520a948-5c36-437d-a503-75bd9c74aa53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:51.780631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520a948-5c36-437d-a503-75bd9c74aa53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:51.782061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520a948-5c36-437d-a503-75bd9c74aa53 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:51.792195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1184/2344] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:52.058030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d90f2c-74b7-413d-91b0-b455d4f36f10 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:52.059572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d0d90f2c-74b7-413d-91b0-b455d4f36f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:52.071944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d90f2c-74b7-413d-91b0-b455d4f36f10 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:52.078131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:52.078989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.079269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.079571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] PATH_INFO: `/v3/projects/804664f72d66416584e0953e91f4405c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.080865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=804664f72d66416584e0953e91f4405c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:52.083618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:52.138212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:52.141203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804664f72d66416584e0953e91f4405c', 'request_id': 'req-1ac4910d-4631-43ad-b01f-71814faa90f3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:52.148621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804664f72d66416584e0953e91f4405c', 'request_id': 'req-1ac4910d-4631-43ad-b01f-71814faa90f3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:52.155698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804664f72d66416584e0953e91f4405c', 'request_id': 'req-1ac4910d-4631-43ad-b01f-71814faa90f3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:52.169658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] The token cache is being invalidate because project 804664f72d66416584e0953e91f4405c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:11:52.170143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:52.170799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1ac4910d-4631-43ad-b01f-71814faa90f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:52.172851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1161/2345] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:11:52 2022] DELETE /identity/v3/projects/804664f72d66416584e0953e91f4405c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:52.177367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675c38e-71a4-43d6-b217-9d022e2b56c1 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.177651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675c38e-71a4-43d6-b217-9d022e2b56c1 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.177925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675c38e-71a4-43d6-b217-9d022e2b56c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.198387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-7675c38e-71a4-43d6-b217-9d022e2b56c1 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:52.199631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7675c38e-71a4-43d6-b217-9d022e2b56c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:52.217762 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:52.270395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1185/2346] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:52.272288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451042ec-90e2-4636-9623-6d3892a402a1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.272599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451042ec-90e2-4636-9623-6d3892a402a1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.272876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451042ec-90e2-4636-9623-6d3892a402a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.293636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-451042ec-90e2-4636-9623-6d3892a402a1 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:52.294874 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-451042ec-90e2-4636-9623-6d3892a402a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:52.303157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1162/2347] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:52.307936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675c38e-71a4-43d6-b217-9d022e2b56c1 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:52.318614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675c38e-71a4-43d6-b217-9d022e2b56c1 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:52.323443 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e0897-c37e-4b1d-bb49-79e816e3b932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:52.324141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0897-c37e-4b1d-bb49-79e816e3b932 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.324488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0897-c37e-4b1d-bb49-79e816e3b932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.324830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0897-c37e-4b1d-bb49-79e816e3b932 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.325635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e0897-c37e-4b1d-bb49-79e816e3b932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:11:52.326008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e0897-c37e-4b1d-bb49-79e816e3b932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:52.327756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e0897-c37e-4b1d-bb49-79e816e3b932 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:52.343462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1186/2348] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:11:52.344032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451042ec-90e2-4636-9623-6d3892a402a1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:52.354152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451042ec-90e2-4636-9623-6d3892a402a1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:52.366512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0f765-eaa3-45da-bddf-288c7ccc63df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:52.367203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0f765-eaa3-45da-bddf-288c7ccc63df admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.367552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0f765-eaa3-45da-bddf-288c7ccc63df admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.367921 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0f765-eaa3-45da-bddf-288c7ccc63df admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.368666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0f765-eaa3-45da-bddf-288c7ccc63df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:52.371279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0f765-eaa3-45da-bddf-288c7ccc63df admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:52.399589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1163/2349] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:11:52 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:11:52.404262 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e0897-c37e-4b1d-bb49-79e816e3b932 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:52.414143 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e0897-c37e-4b1d-bb49-79e816e3b932 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:52.468944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218e23c-b6f5-4802-9387-1e42cc473e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:52.469570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218e23c-b6f5-4802-9387-1e42cc473e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.469821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218e23c-b6f5-4802-9387-1e42cc473e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.470093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218e23c-b6f5-4802-9387-1e42cc473e67 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.470794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218e23c-b6f5-4802-9387-1e42cc473e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:52.472721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218e23c-b6f5-4802-9387-1e42cc473e67 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:52.494002 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1187/2350] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:11:52 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:11:52.498066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0f765-eaa3-45da-bddf-288c7ccc63df admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:52.508604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0f765-eaa3-45da-bddf-288c7ccc63df admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:52.513240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01869636-67f1-4c4e-90e9-7510afce738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:52.513844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01869636-67f1-4c4e-90e9-7510afce738a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.514124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01869636-67f1-4c4e-90e9-7510afce738a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.514402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01869636-67f1-4c4e-90e9-7510afce738a admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.515164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01869636-67f1-4c4e-90e9-7510afce738a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:52.516764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01869636-67f1-4c4e-90e9-7510afce738a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:52.527285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1164/2351] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:11:52.531018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218e23c-b6f5-4802-9387-1e42cc473e67 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:52.540693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218e23c-b6f5-4802-9387-1e42cc473e67 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:52.546126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809b6e6-0e82-4589-ae0d-a84812d2df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:52.546753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809b6e6-0e82-4589-ae0d-a84812d2df4b admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.547030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809b6e6-0e82-4589-ae0d-a84812d2df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.547299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809b6e6-0e82-4589-ae0d-a84812d2df4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.547993 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809b6e6-0e82-4589-ae0d-a84812d2df4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:52.549624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809b6e6-0e82-4589-ae0d-a84812d2df4b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:52.560065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1188/2352] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:11:52.564264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01869636-67f1-4c4e-90e9-7510afce738a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:52.574342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01869636-67f1-4c4e-90e9-7510afce738a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:52.578991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d67eb2-f432-4ddd-9f50-a7d4f5d704ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:52.579636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d67eb2-f432-4ddd-9f50-a7d4f5d704ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.579917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d67eb2-f432-4ddd-9f50-a7d4f5d704ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.580195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d67eb2-f432-4ddd-9f50-a7d4f5d704ac admin admin] PATH_INFO: `/v3/projects/267112b7380546ed9d8aad6191503ffd/users/675f25ff7ccf4e4b833b65924522c1f8/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.594997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d67eb2-f432-4ddd-9f50-a7d4f5d704ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=267112b7380546ed9d8aad6191503ffd, user_id=675f25ff7ccf4e4b833b65924522c1f8, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:52.597649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d67eb2-f432-4ddd-9f50-a7d4f5d704ac admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:52.611098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1165/2353] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:11:52 2022] PUT /identity/v3/projects/267112b7380546ed9d8aad6191503ffd/users/675f25ff7ccf4e4b833b65924522c1f8/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:52.622465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8d19-960c-4038-958d-09adb32ce5e8 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.622770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8d19-960c-4038-958d-09adb32ce5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.623049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8d19-960c-4038-958d-09adb32ce5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.650478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-6c0f8d19-960c-4038-958d-09adb32ce5e8 None None] MFA Rules not processed for user `675f25ff7ccf4e4b833b65924522c1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:52.652297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6c0f8d19-960c-4038-958d-09adb32ce5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:52.715679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1189/2354] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:11:52.726200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d67eb2-f432-4ddd-9f50-a7d4f5d704ac admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:52.728047 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-32d67eb2-f432-4ddd-9f50-a7d4f5d704ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:52.786486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d67eb2-f432-4ddd-9f50-a7d4f5d704ac admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:52.790235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f21027-cb1b-4c9f-a502-13ca518d4ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:52.790889 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f21027-cb1b-4c9f-a502-13ca518d4ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:52.791167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f21027-cb1b-4c9f-a502-13ca518d4ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:52.791441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f21027-cb1b-4c9f-a502-13ca518d4ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:52.799954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f21027-cb1b-4c9f-a502-13ca518d4ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:52.801370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f21027-cb1b-4c9f-a502-13ca518d4ed7 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:52.810049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1166/2355] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:11:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:59.172329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f8d19-960c-4038-958d-09adb32ce5e8 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:59.191700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:59.235478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f8d19-960c-4038-958d-09adb32ce5e8 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:59.239921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:59.240565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:59.240825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:59.241095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] PATH_INFO: `/v3/users/675f25ff7ccf4e4b833b65924522c1f8` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:59.242240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] RBAC: Authorizing `identity:delete_user(user_id=675f25ff7ccf4e4b833b65924522c1f8)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:59.244212 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:59.290240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675f25ff7ccf4e4b833b65924522c1f8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:59.290932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675f25ff7ccf4e4b833b65924522c1f8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:59.299239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675f25ff7ccf4e4b833b65924522c1f8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:59.314679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675f25ff7ccf4e4b833b65924522c1f8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:59.315342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675f25ff7ccf4e4b833b65924522c1f8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:59.327881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1190/2356] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:11:59 2022] DELETE /identity/v3/users/675f25ff7ccf4e4b833b65924522c1f8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:11:59.332357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3218f-0c16-44ae-8659-99ed29edf1ee None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:59.332823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3218f-0c16-44ae-8659-99ed29edf1ee None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:59.332923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3218f-0c16-44ae-8659-99ed29edf1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:59.351609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-44f3218f-0c16-44ae-8659-99ed29edf1ee None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:11:59.352958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-44f3218f-0c16-44ae-8659-99ed29edf1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:59.411447 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1167/2357] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:11:59.420960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:59.422376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:59.480882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf166fc-c2d3-47fa-8bfa-c70dedac745d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:59.484583 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d125f4-420d-4bac-8736-250a602e672a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:59.485183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d125f4-420d-4bac-8736-250a602e672a service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:59.485458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d125f4-420d-4bac-8736-250a602e672a service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:59.485726 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d125f4-420d-4bac-8736-250a602e672a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:59.494595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d125f4-420d-4bac-8736-250a602e672a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:59.496027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d125f4-420d-4bac-8736-250a602e672a service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:59.505186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1191/2358] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:59.885578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3218f-0c16-44ae-8659-99ed29edf1ee None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:11:59.887724 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-44f3218f-0c16-44ae-8659-99ed29edf1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:11:59.903976 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3218f-0c16-44ae-8659-99ed29edf1ee None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:11:59.915826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:11:59.916488 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:11:59.916767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:11:59.917067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] PATH_INFO: `/v3/projects/267112b7380546ed9d8aad6191503ffd` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:11:59.918273 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=267112b7380546ed9d8aad6191503ffd)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:11:59.920339 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:11:59.929633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:59.980417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267112b7380546ed9d8aad6191503ffd', 'request_id': 'req-bef7978e-a369-4acc-bdb8-a974da4bb442'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:59.986741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267112b7380546ed9d8aad6191503ffd', 'request_id': 'req-bef7978e-a369-4acc-bdb8-a974da4bb442'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:11:59.994049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267112b7380546ed9d8aad6191503ffd', 'request_id': 'req-bef7978e-a369-4acc-bdb8-a974da4bb442'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:00.015189 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] The token cache is being invalidate because project 267112b7380546ed9d8aad6191503ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:12:00.015496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:00.016132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bef7978e-a369-4acc-bdb8-a974da4bb442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:00.017876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1168/2359] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:11:59 2022] DELETE /identity/v3/projects/267112b7380546ed9d8aad6191503ffd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:12:00.023251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ac0a6-9cec-44bf-8d7c-b7da26ca5852 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.023540 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ac0a6-9cec-44bf-8d7c-b7da26ca5852 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.023819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ac0a6-9cec-44bf-8d7c-b7da26ca5852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.047925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-8e8ac0a6-9cec-44bf-8d7c-b7da26ca5852 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:00.049201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8e8ac0a6-9cec-44bf-8d7c-b7da26ca5852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:00.086006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:00.115731 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1192/2360] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:00.124036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843199-36af-414c-903c-0c17c9255e22 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.124322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843199-36af-414c-903c-0c17c9255e22 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.124620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843199-36af-414c-903c-0c17c9255e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.144930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-29843199-36af-414c-903c-0c17c9255e22 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:00.146129 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-29843199-36af-414c-903c-0c17c9255e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:00.154790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1169/2361] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:00.159021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ac0a6-9cec-44bf-8d7c-b7da26ca5852 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.168968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ac0a6-9cec-44bf-8d7c-b7da26ca5852 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.173731 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa19c5-e5b8-4322-93f6-781254ae06dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.174322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa19c5-e5b8-4322-93f6-781254ae06dd admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.174643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa19c5-e5b8-4322-93f6-781254ae06dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.174916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa19c5-e5b8-4322-93f6-781254ae06dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.175603 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa19c5-e5b8-4322-93f6-781254ae06dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:12:00.175903 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa19c5-e5b8-4322-93f6-781254ae06dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.177491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa19c5-e5b8-4322-93f6-781254ae06dd admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.190046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1193/2362] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:12:00.194321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843199-36af-414c-903c-0c17c9255e22 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.204042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843199-36af-414c-903c-0c17c9255e22 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.208698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839b309-2ac4-4b79-b1b2-b707e1e79ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.209293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839b309-2ac4-4b79-b1b2-b707e1e79ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.209567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839b309-2ac4-4b79-b1b2-b707e1e79ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.209836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839b309-2ac4-4b79-b1b2-b707e1e79ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.210523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839b309-2ac4-4b79-b1b2-b707e1e79ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.212408 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839b309-2ac4-4b79-b1b2-b707e1e79ba1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.238153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1170/2363] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:12:00 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:12:00.242335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa19c5-e5b8-4322-93f6-781254ae06dd admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.252813 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa19c5-e5b8-4322-93f6-781254ae06dd admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.310865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4de3b-0d6c-4bd4-bd94-712f43a299e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.311481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4de3b-0d6c-4bd4-bd94-712f43a299e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.311763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4de3b-0d6c-4bd4-bd94-712f43a299e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.312034 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4de3b-0d6c-4bd4-bd94-712f43a299e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.312739 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4de3b-0d6c-4bd4-bd94-712f43a299e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.315055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4de3b-0d6c-4bd4-bd94-712f43a299e3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.335529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1194/2364] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:12:00 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:12:00.339677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839b309-2ac4-4b79-b1b2-b707e1e79ba1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.349907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839b309-2ac4-4b79-b1b2-b707e1e79ba1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.355086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dd844-7126-4fbb-a9f8-ccfabf9883e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.355693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dd844-7126-4fbb-a9f8-ccfabf9883e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.355974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dd844-7126-4fbb-a9f8-ccfabf9883e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.356250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dd844-7126-4fbb-a9f8-ccfabf9883e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.356944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dd844-7126-4fbb-a9f8-ccfabf9883e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.358804 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dd844-7126-4fbb-a9f8-ccfabf9883e0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.368781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1171/2365] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:12:00.373108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4de3b-0d6c-4bd4-bd94-712f43a299e3 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.383014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4de3b-0d6c-4bd4-bd94-712f43a299e3 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.387913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049dcbe-3a12-4e71-9d86-acda130f0e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.388520 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049dcbe-3a12-4e71-9d86-acda130f0e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.388801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049dcbe-3a12-4e71-9d86-acda130f0e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.389075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049dcbe-3a12-4e71-9d86-acda130f0e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.389772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049dcbe-3a12-4e71-9d86-acda130f0e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.391488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049dcbe-3a12-4e71-9d86-acda130f0e19 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.402070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1195/2366] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:12:00.406097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dd844-7126-4fbb-a9f8-ccfabf9883e0 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.415866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dd844-7126-4fbb-a9f8-ccfabf9883e0 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.421080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efb9a6-4788-4f00-9d80-f03d6f0288ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.421667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efb9a6-4788-4f00-9d80-f03d6f0288ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.421941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efb9a6-4788-4f00-9d80-f03d6f0288ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.422211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efb9a6-4788-4f00-9d80-f03d6f0288ae admin admin] PATH_INFO: `/v3/projects/2a2b6f84a4464873b290b8b801b23d78/users/0777825c73f74892aaf5a936369cfe7a/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.437145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efb9a6-4788-4f00-9d80-f03d6f0288ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2b6f84a4464873b290b8b801b23d78, user_id=0777825c73f74892aaf5a936369cfe7a, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.440084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efb9a6-4788-4f00-9d80-f03d6f0288ae admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.453445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1172/2367] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:12:00 2022] PUT /identity/v3/projects/2a2b6f84a4464873b290b8b801b23d78/users/0777825c73f74892aaf5a936369cfe7a/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:12:00.520560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ddf03-4f2e-4de4-808b-5ac4d85d6ee8 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.520849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ddf03-4f2e-4de4-808b-5ac4d85d6ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.521129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ddf03-4f2e-4de4-808b-5ac4d85d6ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.548659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-8b5ddf03-4f2e-4de4-808b-5ac4d85d6ee8 None None] MFA Rules not processed for user `0777825c73f74892aaf5a936369cfe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:00.549880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8b5ddf03-4f2e-4de4-808b-5ac4d85d6ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:00.612312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1196/2368] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:12:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:00.617000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efb9a6-4788-4f00-9d80-f03d6f0288ae admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.679310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efb9a6-4788-4f00-9d80-f03d6f0288ae admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.684112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d66cf-3435-4589-963d-bd450420d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.684809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d66cf-3435-4589-963d-bd450420d30e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.685100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d66cf-3435-4589-963d-bd450420d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.685411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d66cf-3435-4589-963d-bd450420d30e admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.686090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d66cf-3435-4589-963d-bd450420d30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.688285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d66cf-3435-4589-963d-bd450420d30e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.714929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1173/2369] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:12:00 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:12:00.719092 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ddf03-4f2e-4de4-808b-5ac4d85d6ee8 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.730518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ddf03-4f2e-4de4-808b-5ac4d85d6ee8 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.761796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:00.786833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558df52c-73f5-48d1-a83d-c5dd14e6a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.787444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558df52c-73f5-48d1-a83d-c5dd14e6a17c admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.787725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558df52c-73f5-48d1-a83d-c5dd14e6a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.787998 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558df52c-73f5-48d1-a83d-c5dd14e6a17c admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.788662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558df52c-73f5-48d1-a83d-c5dd14e6a17c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.790619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558df52c-73f5-48d1-a83d-c5dd14e6a17c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.810875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1197/2370] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:12:00 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:12:00.815172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d66cf-3435-4589-963d-bd450420d30e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.825412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d66cf-3435-4589-963d-bd450420d30e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.829959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967e50d-273f-4220-bebf-96b0a5b84173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.830597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e50d-273f-4220-bebf-96b0a5b84173 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.830876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e50d-273f-4220-bebf-96b0a5b84173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.831144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e50d-273f-4220-bebf-96b0a5b84173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.831828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967e50d-273f-4220-bebf-96b0a5b84173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.833417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967e50d-273f-4220-bebf-96b0a5b84173 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.844578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1174/2371] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:12:00.849110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558df52c-73f5-48d1-a83d-c5dd14e6a17c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.861647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558df52c-73f5-48d1-a83d-c5dd14e6a17c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.867581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283485f-399a-4aa8-8768-191f63c815ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.868453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283485f-399a-4aa8-8768-191f63c815ab admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.868837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283485f-399a-4aa8-8768-191f63c815ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.870664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283485f-399a-4aa8-8768-191f63c815ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.870664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283485f-399a-4aa8-8768-191f63c815ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.871766 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283485f-399a-4aa8-8768-191f63c815ab admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.884463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1198/2372] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:12:00.889035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967e50d-273f-4220-bebf-96b0a5b84173 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:00.899744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967e50d-273f-4220-bebf-96b0a5b84173 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:00.905198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccdfe5-0947-444f-9e4e-ddd88b6b510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:00.905904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccdfe5-0947-444f-9e4e-ddd88b6b510d admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.906187 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccdfe5-0947-444f-9e4e-ddd88b6b510d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.906492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccdfe5-0947-444f-9e4e-ddd88b6b510d admin admin] PATH_INFO: `/v3/projects/03adeb292bfa4f50aa18b2d1dcdcd152/users/6306419df27540c58f78ccb52e3f0f1b/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.908907 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:00.930105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccdfe5-0947-444f-9e4e-ddd88b6b510d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03adeb292bfa4f50aa18b2d1dcdcd152, user_id=6306419df27540c58f78ccb52e3f0f1b, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:00.933041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccdfe5-0947-444f-9e4e-ddd88b6b510d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:00.947674 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1175/2373] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:12:00 2022] PUT /identity/v3/projects/03adeb292bfa4f50aa18b2d1dcdcd152/users/6306419df27540c58f78ccb52e3f0f1b/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:12:00.958274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a6f6-42e3-48ad-b3f5-49f88747519e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:00.959110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a6f6-42e3-48ad-b3f5-49f88747519e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:00.959310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a6f6-42e3-48ad-b3f5-49f88747519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:00.992893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-bd22a6f6-42e3-48ad-b3f5-49f88747519e None None] MFA Rules not processed for user `6306419df27540c58f78ccb52e3f0f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:00.994090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-bd22a6f6-42e3-48ad-b3f5-49f88747519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:01.064261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1199/2374] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:12:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:12:01.068411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccdfe5-0947-444f-9e4e-ddd88b6b510d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:01.141800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccdfe5-0947-444f-9e4e-ddd88b6b510d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:01.146909 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7c206-b3be-4b64-987b-176ab36c9174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:01.147531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7c206-b3be-4b64-987b-176ab36c9174 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:01.147809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7c206-b3be-4b64-987b-176ab36c9174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:01.148082 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7c206-b3be-4b64-987b-176ab36c9174 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:01.148749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7c206-b3be-4b64-987b-176ab36c9174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:01.150687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7c206-b3be-4b64-987b-176ab36c9174 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:01.180382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1176/2375] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:12:01 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:12:01.184259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22a6f6-42e3-48ad-b3f5-49f88747519e None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:01.195719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22a6f6-42e3-48ad-b3f5-49f88747519e None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:01.274978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf1963-6fbe-4622-9841-a0b084a3a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:01.275733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf1963-6fbe-4622-9841-a0b084a3a57d admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:01.276110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf1963-6fbe-4622-9841-a0b084a3a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:01.277155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf1963-6fbe-4622-9841-a0b084a3a57d admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:01.278197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf1963-6fbe-4622-9841-a0b084a3a57d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:01.280219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf1963-6fbe-4622-9841-a0b084a3a57d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:01.312966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1200/2376] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:12:01 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:12:01.314950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7c206-b3be-4b64-987b-176ab36c9174 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:01.327059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7c206-b3be-4b64-987b-176ab36c9174 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:01.333623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22309239-0b15-4642-ac3e-e78854b4504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:01.334356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22309239-0b15-4642-ac3e-e78854b4504d admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:01.334982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22309239-0b15-4642-ac3e-e78854b4504d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:01.335355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22309239-0b15-4642-ac3e-e78854b4504d admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:01.337010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22309239-0b15-4642-ac3e-e78854b4504d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:01.339918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22309239-0b15-4642-ac3e-e78854b4504d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:01.351753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1177/2377] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:12:01.357058 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf1963-6fbe-4622-9841-a0b084a3a57d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:01.371489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf1963-6fbe-4622-9841-a0b084a3a57d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:01.377794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad5619-8183-44b6-ab0d-3db9de798823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:01.379013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad5619-8183-44b6-ab0d-3db9de798823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:01.379485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad5619-8183-44b6-ab0d-3db9de798823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:01.379942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad5619-8183-44b6-ab0d-3db9de798823 admin admin] PATH_INFO: `/v3/projects/97cb89c94b2346b1b6a07d5fac1c9e70/users/c5d68aa5f781463e8f5a095f26a205ec/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:01.398791 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad5619-8183-44b6-ab0d-3db9de798823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97cb89c94b2346b1b6a07d5fac1c9e70, user_id=c5d68aa5f781463e8f5a095f26a205ec, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:01.402131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad5619-8183-44b6-ab0d-3db9de798823 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:01.417227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1201/2378] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:12:01 2022] PUT /identity/v3/projects/97cb89c94b2346b1b6a07d5fac1c9e70/users/c5d68aa5f781463e8f5a095f26a205ec/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:12:01.426817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22309239-0b15-4642-ac3e-e78854b4504d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:01.437527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22309239-0b15-4642-ac3e-e78854b4504d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:01.496328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88142c-57e1-4f91-bfb4-6020ff2ad1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:01.496951 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88142c-57e1-4f91-bfb4-6020ff2ad1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:01.497232 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88142c-57e1-4f91-bfb4-6020ff2ad1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:01.497503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88142c-57e1-4f91-bfb4-6020ff2ad1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:01.498199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88142c-57e1-4f91-bfb4-6020ff2ad1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:01.499824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88142c-57e1-4f91-bfb4-6020ff2ad1d1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:01.509996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1178/2379] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:12:01.514840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad5619-8183-44b6-ab0d-3db9de798823 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:01.525245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad5619-8183-44b6-ab0d-3db9de798823 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:01.530109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90c22f-402b-49d9-9200-899823e92bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:01.530804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90c22f-402b-49d9-9200-899823e92bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:01.531088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90c22f-402b-49d9-9200-899823e92bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:01.531367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90c22f-402b-49d9-9200-899823e92bd2 admin admin] PATH_INFO: `/v3/projects/97cb89c94b2346b1b6a07d5fac1c9e70/users/c5d68aa5f781463e8f5a095f26a205ec/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:01.533313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90c22f-402b-49d9-9200-899823e92bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97cb89c94b2346b1b6a07d5fac1c9e70, user_id=c5d68aa5f781463e8f5a095f26a205ec, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:01.536018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90c22f-402b-49d9-9200-899823e92bd2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:01.539222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:01.548361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1202/2380] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:12:01 2022] PUT /identity/v3/projects/97cb89c94b2346b1b6a07d5fac1c9e70/users/c5d68aa5f781463e8f5a095f26a205ec/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:12:01.559221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5a8d-6478-488d-a9a9-8c38260f1904 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:01.559501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5a8d-6478-488d-a9a9-8c38260f1904 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:01.559774 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5a8d-6478-488d-a9a9-8c38260f1904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:01.590293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cdcc5a8d-6478-488d-a9a9-8c38260f1904 None None] MFA Rules not processed for user `c5d68aa5f781463e8f5a095f26a205ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:01.592368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cdcc5a8d-6478-488d-a9a9-8c38260f1904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:01.637191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:01.665046 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1179/2381] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:12:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:01.676718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90c22f-402b-49d9-9200-899823e92bd2 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:01.678422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-1b90c22f-402b-49d9-9200-899823e92bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:01.743712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90c22f-402b-49d9-9200-899823e92bd2 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:01.747416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1027d-981d-4a69-9441-2a6225a1ac21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:01.748425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1027d-981d-4a69-9441-2a6225a1ac21 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:01.748425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1027d-981d-4a69-9441-2a6225a1ac21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:01.748642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1027d-981d-4a69-9441-2a6225a1ac21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:01.806617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1027d-981d-4a69-9441-2a6225a1ac21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:01.808063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1027d-981d-4a69-9441-2a6225a1ac21 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:01.817491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1203/2382] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:12:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:12:03.312338 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5a8d-6478-488d-a9a9-8c38260f1904 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:03.322076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5a8d-6478-488d-a9a9-8c38260f1904 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:03.326154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42b03a-aab5-4a30-848b-fb3c03649d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:03.326818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42b03a-aab5-4a30-848b-fb3c03649d3e service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:03.327095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42b03a-aab5-4a30-848b-fb3c03649d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:03.327363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42b03a-aab5-4a30-848b-fb3c03649d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:03.386457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42b03a-aab5-4a30-848b-fb3c03649d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:03.387827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42b03a-aab5-4a30-848b-fb3c03649d3e service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:03.397792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1180/2383] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:12:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:12:04.010254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1027d-981d-4a69-9441-2a6225a1ac21 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:04.019542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1027d-981d-4a69-9441-2a6225a1ac21 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:04.023248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3741b-5af8-4340-a8f3-25af746b19d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:04.023851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3741b-5af8-4340-a8f3-25af746b19d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:04.024134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3741b-5af8-4340-a8f3-25af746b19d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:04.024419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3741b-5af8-4340-a8f3-25af746b19d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:04.033300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3741b-5af8-4340-a8f3-25af746b19d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:04.034763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3741b-5af8-4340-a8f3-25af746b19d7 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:04.044970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1204/2384] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:12:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:12:07.882292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42b03a-aab5-4a30-848b-fb3c03649d3e service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:07.943128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42b03a-aab5-4a30-848b-fb3c03649d3e service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:07.947541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:07.948197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:07.948471 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:07.948741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] PATH_INFO: `/v3/users/0777825c73f74892aaf5a936369cfe7a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:07.949875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=0777825c73f74892aaf5a936369cfe7a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:07.951847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:07.996370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0777825c73f74892aaf5a936369cfe7a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:07.997011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0777825c73f74892aaf5a936369cfe7a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.007253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0777825c73f74892aaf5a936369cfe7a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.021446 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0777825c73f74892aaf5a936369cfe7a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.022140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0777825c73f74892aaf5a936369cfe7a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.035279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1181/2385] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:12:07 2022] DELETE /identity/v3/users/0777825c73f74892aaf5a936369cfe7a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:12:08.035479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:08.040225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28301343-7d65-4426-9971-47026a32e794 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:08.040730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28301343-7d65-4426-9971-47026a32e794 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:08.040730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28301343-7d65-4426-9971-47026a32e794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:08.061563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-28301343-7d65-4426-9971-47026a32e794 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:08.062814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-28301343-7d65-4426-9971-47026a32e794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:08.073989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:08.075780 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:08.125543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1205/2386] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:12:08.135093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28301343-7d65-4426-9971-47026a32e794 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:08.136732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-28301343-7d65-4426-9971-47026a32e794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:08.145876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723939c1-0e93-4220-bd0e-266a8b4320ea admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:08.152101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:08.152745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:08.153023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:08.153297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] PATH_INFO: `/v3/users/637d43f9b56640c98af67c7b47159bb2` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:08.155060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=637d43f9b56640c98af67c7b47159bb2)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:08.157796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:08.182130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=100 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:08.199125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28301343-7d65-4426-9971-47026a32e794 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:08.202788 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f7eb2-3366-483e-b321-0b676a4f5ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:08.203399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7eb2-3366-483e-b321-0b676a4f5ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:08.203691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7eb2-3366-483e-b321-0b676a4f5ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:08.203950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7eb2-3366-483e-b321-0b676a4f5ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:08.213280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f7eb2-3366-483e-b321-0b676a4f5ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:08.214886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f7eb2-3366-483e-b321-0b676a4f5ba3 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:08.217877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637d43f9b56640c98af67c7b47159bb2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.218564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637d43f9b56640c98af67c7b47159bb2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.225508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1206/2387] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:12:08.226143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637d43f9b56640c98af67c7b47159bb2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.239235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637d43f9b56640c98af67c7b47159bb2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.239994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637d43f9b56640c98af67c7b47159bb2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.252723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1182/2388] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:12:08 2022] DELETE /identity/v3/users/637d43f9b56640c98af67c7b47159bb2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:12:08.256982 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c3b5-1d9c-4b0b-b50f-98f31634a9a9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:08.257390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c3b5-1d9c-4b0b-b50f-98f31634a9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:08.257690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c3b5-1d9c-4b0b-b50f-98f31634a9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:08.278117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d0f2c3b5-1d9c-4b0b-b50f-98f31634a9a9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:08.279639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d0f2c3b5-1d9c-4b0b-b50f-98f31634a9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:08.342951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1207/2389] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:08.352675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:08.354061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:08.412245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c363eb-bd94-4a98-82de-e59e357a8551 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:08.415878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514ed2c-91a7-4002-aa57-6cdfe205e280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:08.416496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514ed2c-91a7-4002-aa57-6cdfe205e280 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:08.416773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514ed2c-91a7-4002-aa57-6cdfe205e280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:08.417050 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514ed2c-91a7-4002-aa57-6cdfe205e280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:08.426959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514ed2c-91a7-4002-aa57-6cdfe205e280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:08.428382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514ed2c-91a7-4002-aa57-6cdfe205e280 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:08.437760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1183/2390] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:12:08.502456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2c3b5-1d9c-4b0b-b50f-98f31634a9a9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:08.503969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d0f2c3b5-1d9c-4b0b-b50f-98f31634a9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:08.517594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2c3b5-1d9c-4b0b-b50f-98f31634a9a9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:08.522882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:08.523763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:08.524036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:08.524417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] PATH_INFO: `/v3/projects/2a2b6f84a4464873b290b8b801b23d78` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:08.525699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2b6f84a4464873b290b8b801b23d78)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:08.527778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:08.578615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2b6f84a4464873b290b8b801b23d78', 'request_id': 'req-9ff49c69-ec9b-4e83-b558-add136e4faab'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.585834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2b6f84a4464873b290b8b801b23d78', 'request_id': 'req-9ff49c69-ec9b-4e83-b558-add136e4faab'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.596445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2b6f84a4464873b290b8b801b23d78', 'request_id': 'req-9ff49c69-ec9b-4e83-b558-add136e4faab'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.609947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] The token cache is being invalidate because project 2a2b6f84a4464873b290b8b801b23d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:12:08.610229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.611217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.612500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1208/2391] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:12:08 2022] DELETE /identity/v3/projects/2a2b6f84a4464873b290b8b801b23d78 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:12:08.616455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514ed2c-91a7-4002-aa57-6cdfe205e280 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:08.626122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514ed2c-91a7-4002-aa57-6cdfe205e280 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:08.639138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:08.686686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:08.687330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:08.687608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:08.687881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] PATH_INFO: `/v3/users/6306419df27540c58f78ccb52e3f0f1b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:08.689347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6306419df27540c58f78ccb52e3f0f1b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:08.691328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:08.735469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:08.737037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:08.742379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6306419df27540c58f78ccb52e3f0f1b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.743293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6306419df27540c58f78ccb52e3f0f1b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.752132 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6306419df27540c58f78ccb52e3f0f1b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.753356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49c69-ec9b-4e83-b558-add136e4faab admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:08.760613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:08.761314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:08.761663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:08.761858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] PATH_INFO: `/v3/projects/4ca5c1dd1de945ceaa94015f9837fed2` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:08.763818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca5c1dd1de945ceaa94015f9837fed2)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:08.765691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:08.768846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6306419df27540c58f78ccb52e3f0f1b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.769605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6306419df27540c58f78ccb52e3f0f1b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.782505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1184/2392] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:12:08 2022] DELETE /identity/v3/users/6306419df27540c58f78ccb52e3f0f1b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:12:08.817825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca5c1dd1de945ceaa94015f9837fed2', 'request_id': 'req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.826062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca5c1dd1de945ceaa94015f9837fed2', 'request_id': 'req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.828423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:08.834373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca5c1dd1de945ceaa94015f9837fed2', 'request_id': 'req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.848084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] The token cache is being invalidate because project 4ca5c1dd1de945ceaa94015f9837fed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:12:08.848369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.849059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:08.850925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1209/2393] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:12:08 2022] DELETE /identity/v3/projects/4ca5c1dd1de945ceaa94015f9837fed2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:12:09.089821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:09.091424 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:09.162315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c351080-8745-4fb9-9b13-8d7095804209 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:09.214252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:09.235896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:09.236560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:09.236843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:09.237119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] PATH_INFO: `/v3/projects/03adeb292bfa4f50aa18b2d1dcdcd152` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:09.238410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03adeb292bfa4f50aa18b2d1dcdcd152)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:09.240400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:09.292549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03adeb292bfa4f50aa18b2d1dcdcd152', 'request_id': 'req-708cef42-f760-41c9-acb5-930beb54f388'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.298993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03adeb292bfa4f50aa18b2d1dcdcd152', 'request_id': 'req-708cef42-f760-41c9-acb5-930beb54f388'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.305299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03adeb292bfa4f50aa18b2d1dcdcd152', 'request_id': 'req-708cef42-f760-41c9-acb5-930beb54f388'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.328036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] The token cache is being invalidate because project 03adeb292bfa4f50aa18b2d1dcdcd152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:12:09.328334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.329025 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.331830 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1185/2394] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:12:09 2022] DELETE /identity/v3/projects/03adeb292bfa4f50aa18b2d1dcdcd152 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:12:09.336078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:09.337453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:09.350372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24a7a-d0b4-4028-b2be-a05e1c22e7f2 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:09.406462 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:09.407101 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:09.407382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:09.407653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] PATH_INFO: `/v3/users/c5d68aa5f781463e8f5a095f26a205ec` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:09.408807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d68aa5f781463e8f5a095f26a205ec)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:09.410756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:09.458556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d68aa5f781463e8f5a095f26a205ec'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.459203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d68aa5f781463e8f5a095f26a205ec'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.466173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d68aa5f781463e8f5a095f26a205ec'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.478350 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d68aa5f781463e8f5a095f26a205ec'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.479011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-38b040e8-1287-4f10-900b-461d5ebecab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d68aa5f781463e8f5a095f26a205ec'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.491523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1210/2395] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:12:09 2022] DELETE /identity/v3/users/c5d68aa5f781463e8f5a095f26a205ec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:12:09.765497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:09.767113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:09.783802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cef42-f760-41c9-acb5-930beb54f388 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:09.839898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:09.840473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:09.840747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:09.841564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] PATH_INFO: `/v3/projects/97cb89c94b2346b1b6a07d5fac1c9e70` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:09.842797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97cb89c94b2346b1b6a07d5fac1c9e70)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:09.844839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:09.892023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97cb89c94b2346b1b6a07d5fac1c9e70', 'request_id': 'req-77de6273-ee30-46b7-b215-3050e5a8ba7c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.897470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97cb89c94b2346b1b6a07d5fac1c9e70', 'request_id': 'req-77de6273-ee30-46b7-b215-3050e5a8ba7c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.904065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97cb89c94b2346b1b6a07d5fac1c9e70', 'request_id': 'req-77de6273-ee30-46b7-b215-3050e5a8ba7c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.915865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] The token cache is being invalidate because project 97cb89c94b2346b1b6a07d5fac1c9e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:12:09.916153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.916785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:12:09.918383 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1186/2396] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:12:09 2022] DELETE /identity/v3/projects/97cb89c94b2346b1b6a07d5fac1c9e70 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:12:10.936407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1cc87-f36c-46ea-88cd-fe4635a38a6d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:10.936875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1cc87-f36c-46ea-88cd-fe4635a38a6d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:10.936968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1cc87-f36c-46ea-88cd-fe4635a38a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:10.956196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-98b1cc87-f36c-46ea-88cd-fe4635a38a6d None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:10.957403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-98b1cc87-f36c-46ea-88cd-fe4635a38a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:11.013207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1211/2397] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:12:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:11.027032 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:11.028510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:11.035971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:11.100402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de6273-ee30-46b7-b215-3050e5a8ba7c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:11.105512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0f32e-b3c1-4384-bf09-113570d4265d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:11.106126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0f32e-b3c1-4384-bf09-113570d4265d service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:11.106407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0f32e-b3c1-4384-bf09-113570d4265d service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:11.107249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0f32e-b3c1-4384-bf09-113570d4265d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:11.116228 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0f32e-b3c1-4384-bf09-113570d4265d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:11.117812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0f32e-b3c1-4384-bf09-113570d4265d service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:11.125883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1187/2398] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:12:21.006521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=83,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:21.122630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=30 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:25.100120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1cc87-f36c-46ea-88cd-fe4635a38a6d None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:25.101524 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-98b1cc87-f36c-46ea-88cd-fe4635a38a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:25.169459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1cc87-f36c-46ea-88cd-fe4635a38a6d None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:25.174383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80d9b0-4f7f-40ce-902e-0009ebfd7447 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:25.175018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d9b0-4f7f-40ce-902e-0009ebfd7447 service placement] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:25.175296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d9b0-4f7f-40ce-902e-0009ebfd7447 service placement] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:25.175568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d9b0-4f7f-40ce-902e-0009ebfd7447 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:25.177311 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6e80d9b0-4f7f-40ce-902e-0009ebfd7447 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:25.188491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80d9b0-4f7f-40ce-902e-0009ebfd7447 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:25.190360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80d9b0-4f7f-40ce-902e-0009ebfd7447 service placement] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:25.200805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1212/2399] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:12:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:12:26.593576 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bfc65-8695-44ae-b7ed-5cbafcbaba2d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:26.594098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bfc65-8695-44ae-b7ed-5cbafcbaba2d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:26.594272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bfc65-8695-44ae-b7ed-5cbafcbaba2d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:26.595984 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1188/2400] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:12:26.602364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68312b8a-4e58-4ae8-9c80-2f3352b68110 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:26.602891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68312b8a-4e58-4ae8-9c80-2f3352b68110 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:26.602994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68312b8a-4e58-4ae8-9c80-2f3352b68110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:26.623496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-68312b8a-4e58-4ae8-9c80-2f3352b68110 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:26.624605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-68312b8a-4e58-4ae8-9c80-2f3352b68110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:26.693743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1213/2401] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:12:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:26.705642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bfc65-8695-44ae-b7ed-5cbafcbaba2d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:26.707531 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a09bfc65-8695-44ae-b7ed-5cbafcbaba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:26.768822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bfc65-8695-44ae-b7ed-5cbafcbaba2d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:26.772528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309e74-d1ba-441b-a800-6bec8f22639b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece4e0b16a9441b5ba14bbc8ff1c632c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:26.773142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309e74-d1ba-441b-a800-6bec8f22639b service glance] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:26.773421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309e74-d1ba-441b-a800-6bec8f22639b service glance] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:26.773713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309e74-d1ba-441b-a800-6bec8f22639b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:26.783894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309e74-d1ba-441b-a800-6bec8f22639b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:26.785320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309e74-d1ba-441b-a800-6bec8f22639b service glance] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:26.796497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1189/2402] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:12:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:12:26.865125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931eec8-4d84-4db3-b45f-74e5028a8e69 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:26.865416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931eec8-4d84-4db3-b45f-74e5028a8e69 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:26.865688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931eec8-4d84-4db3-b45f-74e5028a8e69 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:26.867103 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1214/2403] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:12:26.871946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e75dc-dc0d-42dc-a912-91f1684e9f0c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:26.872241 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e75dc-dc0d-42dc-a912-91f1684e9f0c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:26.872518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e75dc-dc0d-42dc-a912-91f1684e9f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:26.892035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c76e75dc-dc0d-42dc-a912-91f1684e9f0c None None] MFA Rules not processed for user `50bf5763fbf94aa9b438a1be6ce88c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:26.893236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c76e75dc-dc0d-42dc-a912-91f1684e9f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:26.942858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1190/2404] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:12:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:26.954498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931eec8-4d84-4db3-b45f-74e5028a8e69 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:26.956204 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d931eec8-4d84-4db3-b45f-74e5028a8e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:26.969875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931eec8-4d84-4db3-b45f-74e5028a8e69 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:26.973772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d83c08-f3a8-4414-906c-85f840598550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:26.974365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d83c08-f3a8-4414-906c-85f840598550 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:26.974679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d83c08-f3a8-4414-906c-85f840598550 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:26.974954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d83c08-f3a8-4414-906c-85f840598550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:26.982570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d83c08-f3a8-4414-906c-85f840598550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:26.984087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d83c08-f3a8-4414-906c-85f840598550 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:26.991940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1215/2405] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:12:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:12:27.075501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8c6e8-a92e-4df8-8d5d-c0e126e46437 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:27.075788 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8c6e8-a92e-4df8-8d5d-c0e126e46437 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:27.076067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8c6e8-a92e-4df8-8d5d-c0e126e46437 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:27.077466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1191/2406] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:12:27.082372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4b0f4-6e0a-4b4f-9d9a-b191ec6422d6 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:27.082679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4b0f4-6e0a-4b4f-9d9a-b191ec6422d6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:27.082977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4b0f4-6e0a-4b4f-9d9a-b191ec6422d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:27.102714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d7e4b0f4-6e0a-4b4f-9d9a-b191ec6422d6 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:27.103900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d7e4b0f4-6e0a-4b4f-9d9a-b191ec6422d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:27.113592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1216/2407] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:12:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:27.123798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8c6e8-a92e-4df8-8d5d-c0e126e46437 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:27.134759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8c6e8-a92e-4df8-8d5d-c0e126e46437 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:27.138291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8b118-dee8-4f65-885f-b98cae96ce4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:27.138920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8b118-dee8-4f65-885f-b98cae96ce4b service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:27.139201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8b118-dee8-4f65-885f-b98cae96ce4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:27.139475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8b118-dee8-4f65-885f-b98cae96ce4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:27.149452 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8b118-dee8-4f65-885f-b98cae96ce4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:27.150918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8b118-dee8-4f65-885f-b98cae96ce4b service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:27.162268 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1192/2408] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:12:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:12:29.740820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bf39-6e6d-48bb-9443-9ab3d5114f62 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:29.741307 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bf39-6e6d-48bb-9443-9ab3d5114f62 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:29.741405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bf39-6e6d-48bb-9443-9ab3d5114f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:29.760025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-3014bf39-6e6d-48bb-9443-9ab3d5114f62 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:29.761147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-3014bf39-6e6d-48bb-9443-9ab3d5114f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:29.768767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1217/2409] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:12:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:29.789954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8b118-dee8-4f65-885f-b98cae96ce4b service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:29.800944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8b118-dee8-4f65-885f-b98cae96ce4b service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:29.805752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52720618-6607-48f4-b8d9-c85f277ceb35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:29.806345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720618-6607-48f4-b8d9-c85f277ceb35 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:29.806657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720618-6607-48f4-b8d9-c85f277ceb35 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:29.806956 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720618-6607-48f4-b8d9-c85f277ceb35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:29.815589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52720618-6607-48f4-b8d9-c85f277ceb35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:29.817153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52720618-6607-48f4-b8d9-c85f277ceb35 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:29.824958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1193/2410] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:12:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:12:39.754891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=75 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:39.821845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=61 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:54.970941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889300-1bca-4fe8-8c05-87db1d4a0a27 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:54.972119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889300-1bca-4fe8-8c05-87db1d4a0a27 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:54.972412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889300-1bca-4fe8-8c05-87db1d4a0a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:54.992083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ee889300-1bca-4fe8-8c05-87db1d4a0a27 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:12:54.993322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ee889300-1bca-4fe8-8c05-87db1d4a0a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:12:55.000711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1218/2411] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jul 28 02:12:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:12:55.014131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52720618-6607-48f4-b8d9-c85f277ceb35 service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:12:55.025440 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52720618-6607-48f4-b8d9-c85f277ceb35 service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:12:55.030516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de104fde-76e8-486c-9bb5-2cf9873f272b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:12:55.031098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de104fde-76e8-486c-9bb5-2cf9873f272b service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:12:55.031377 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de104fde-76e8-486c-9bb5-2cf9873f272b service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:12:55.031649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de104fde-76e8-486c-9bb5-2cf9873f272b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:12:55.041143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de104fde-76e8-486c-9bb5-2cf9873f272b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:12:55.042748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de104fde-76e8-486c-9bb5-2cf9873f272b service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:12:55.050974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1194/2412] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:13:04.987248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:13:05.047455 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:13:36.730238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50ae7-7ed4-42e5-b77b-f7dc52fa5a8a None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:13:36.730764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50ae7-7ed4-42e5-b77b-f7dc52fa5a8a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:13:36.730764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50ae7-7ed4-42e5-b77b-f7dc52fa5a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:13:36.749800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9cb50ae7-7ed4-42e5-b77b-f7dc52fa5a8a None None] MFA Rules not processed for user `c88a4ae446ac43b48ee778344caec88c`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:13:36.751013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9cb50ae7-7ed4-42e5-b77b-f7dc52fa5a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:13:36.805319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1219/2413] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:13:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:13:46.798491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=25 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:14:01.789670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de104fde-76e8-486c-9bb5-2cf9873f272b service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:14:01.791229 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-de104fde-76e8-486c-9bb5-2cf9873f272b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:01.846350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de104fde-76e8-486c-9bb5-2cf9873f272b service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:14:01.850415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31f9be-dad4-401d-87ed-291513ec178f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:14:01.851049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f9be-dad4-401d-87ed-291513ec178f service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:01.851330 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f9be-dad4-401d-87ed-291513ec178f service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:01.851615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f9be-dad4-401d-87ed-291513ec178f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:01.853320 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9d31f9be-dad4-401d-87ed-291513ec178f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:01.867068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31f9be-dad4-401d-87ed-291513ec178f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:14:01.868483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31f9be-dad4-401d-87ed-291513ec178f service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:14:01.879396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1195/2414] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:14:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:14:04.500893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb50ae7-7ed4-42e5-b77b-f7dc52fa5a8a None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:14:04.502365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9cb50ae7-7ed4-42e5-b77b-f7dc52fa5a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:04.521264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb50ae7-7ed4-42e5-b77b-f7dc52fa5a8a None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:14:04.525019 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1e28e-eaba-4294-ac2c-c7f656d6a12f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:14:04.525628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1e28e-eaba-4294-ac2c-c7f656d6a12f service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:04.525907 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1e28e-eaba-4294-ac2c-c7f656d6a12f service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:04.526178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1e28e-eaba-4294-ac2c-c7f656d6a12f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:04.527972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a0c1e28e-eaba-4294-ac2c-c7f656d6a12f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:04.541231 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1e28e-eaba-4294-ac2c-c7f656d6a12f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:14:04.542734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1e28e-eaba-4294-ac2c-c7f656d6a12f service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:14:04.553564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1220/2415] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:14:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:14:07.732186 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31f9be-dad4-401d-87ed-291513ec178f service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:14:07.733778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9d31f9be-dad4-401d-87ed-291513ec178f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:07.748000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31f9be-dad4-401d-87ed-291513ec178f service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:14:07.753616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb570b-6cf2-44f6-afba-59b258953738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:14:07.754796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb570b-6cf2-44f6-afba-59b258953738 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:07.755074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb570b-6cf2-44f6-afba-59b258953738 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:07.755344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb570b-6cf2-44f6-afba-59b258953738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:07.757291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-64eb570b-6cf2-44f6-afba-59b258953738 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:07.817998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb570b-6cf2-44f6-afba-59b258953738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:14:07.819638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb570b-6cf2-44f6-afba-59b258953738 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:14:07.828528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1196/2416] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:14:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:14:09.070765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37376f58-292b-4358-9882-deea7a852aa0 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:09.071252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37376f58-292b-4358-9882-deea7a852aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:09.071343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37376f58-292b-4358-9882-deea7a852aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:09.090395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-37376f58-292b-4358-9882-deea7a852aa0 None None] MFA Rules not processed for user `7451d5de3e664f29b3a53699af7a5c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:14:09.091607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-37376f58-292b-4358-9882-deea7a852aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:09.098407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1221/2417] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:14:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:14:09.398341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb570b-6cf2-44f6-afba-59b258953738 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:14:09.407790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb570b-6cf2-44f6-afba-59b258953738 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:14:09.412054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad94115-e527-4d6a-b48c-4a289faccc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:14:09.412654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94115-e527-4d6a-b48c-4a289faccc83 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:09.412930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94115-e527-4d6a-b48c-4a289faccc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:09.413200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94115-e527-4d6a-b48c-4a289faccc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:09.415022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0ad94115-e527-4d6a-b48c-4a289faccc83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:09.424710 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad94115-e527-4d6a-b48c-4a289faccc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:14:09.426173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad94115-e527-4d6a-b48c-4a289faccc83 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:14:09.434022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1197/2418] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:14:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:14:09.986130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37376f58-292b-4358-9882-deea7a852aa0 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:14:10.000839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37376f58-292b-4358-9882-deea7a852aa0 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:14:10.006464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb0bd-ff38-41ad-a251-824c4da6c02b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:14:10.007151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb0bd-ff38-41ad-a251-824c4da6c02b service placement] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:10.007433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb0bd-ff38-41ad-a251-824c4da6c02b service placement] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:10.007705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb0bd-ff38-41ad-a251-824c4da6c02b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:10.009461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-979bb0bd-ff38-41ad-a251-824c4da6c02b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:10.022829 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb0bd-ff38-41ad-a251-824c4da6c02b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:14:10.024850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb0bd-ff38-41ad-a251-824c4da6c02b service placement] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:14:10.039966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1222/2419] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:14:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:14:15.535739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad94115-e527-4d6a-b48c-4a289faccc83 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:14:15.545370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad94115-e527-4d6a-b48c-4a289faccc83 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:14:15.549150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c742d-4d56-4cb3-b7b5-e2352f910dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:14:15.549767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c742d-4d56-4cb3-b7b5-e2352f910dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:15.550042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c742d-4d56-4cb3-b7b5-e2352f910dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:15.550313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c742d-4d56-4cb3-b7b5-e2352f910dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:15.552785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c26c742d-4d56-4cb3-b7b5-e2352f910dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:15.569789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c742d-4d56-4cb3-b7b5-e2352f910dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:14:15.571260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c742d-4d56-4cb3-b7b5-e2352f910dc4 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:14:15.579304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1198/2420] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:14:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:14:20.030771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=15 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:14:25.575764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=66 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:14:44.776874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb0bd-ff38-41ad-a251-824c4da6c02b service placement] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:14:44.787032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb0bd-ff38-41ad-a251-824c4da6c02b service placement] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:14:44.790679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3965d7-fe8c-4941-916a-c42b7053aa37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:14:44.791286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3965d7-fe8c-4941-916a-c42b7053aa37 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:44.791570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3965d7-fe8c-4941-916a-c42b7053aa37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:44.791847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3965d7-fe8c-4941-916a-c42b7053aa37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:44.793639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ea3965d7-fe8c-4941-916a-c42b7053aa37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:44.804809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3965d7-fe8c-4941-916a-c42b7053aa37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:14:44.806289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3965d7-fe8c-4941-916a-c42b7053aa37 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:14:44.816394 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1223/2421] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:14:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:14:51.912445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c742d-4d56-4cb3-b7b5-e2352f910dc4 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:14:51.924679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c742d-4d56-4cb3-b7b5-e2352f910dc4 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:14:51.932334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31089b-0ba3-42de-aacf-381c43934cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:14:51.933198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31089b-0ba3-42de-aacf-381c43934cda service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:51.933691 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31089b-0ba3-42de-aacf-381c43934cda service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:51.934031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31089b-0ba3-42de-aacf-381c43934cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:51.936177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6d31089b-0ba3-42de-aacf-381c43934cda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:52.001467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31089b-0ba3-42de-aacf-381c43934cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:14:52.003438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31089b-0ba3-42de-aacf-381c43934cda service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:14:52.013387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1199/2422] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:14:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:14:52.432571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3965d7-fe8c-4941-916a-c42b7053aa37 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:14:52.434705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ea3965d7-fe8c-4941-916a-c42b7053aa37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:52.461572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3965d7-fe8c-4941-916a-c42b7053aa37 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:14:52.467882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da503d8-d8fe-4f63-b856-d67b6ce729e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:14:52.468738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da503d8-d8fe-4f63-b856-d67b6ce729e1 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:52.469177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da503d8-d8fe-4f63-b856-d67b6ce729e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:52.469606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da503d8-d8fe-4f63-b856-d67b6ce729e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:52.472617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2da503d8-d8fe-4f63-b856-d67b6ce729e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:52.494208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da503d8-d8fe-4f63-b856-d67b6ce729e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:14:52.497804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da503d8-d8fe-4f63-b856-d67b6ce729e1 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:14:52.526757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1224/2423] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:14:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:14:54.594816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31089b-0ba3-42de-aacf-381c43934cda service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:14:54.610668 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31089b-0ba3-42de-aacf-381c43934cda service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:14:54.637371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8063c-e46d-48e1-b80c-0eb1698f917e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:14:54.638405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8063c-e46d-48e1-b80c-0eb1698f917e service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:54.638944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8063c-e46d-48e1-b80c-0eb1698f917e service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:54.639415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8063c-e46d-48e1-b80c-0eb1698f917e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:54.642176 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-89c8063c-e46d-48e1-b80c-0eb1698f917e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:54.669336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8063c-e46d-48e1-b80c-0eb1698f917e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:14:54.671071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8063c-e46d-48e1-b80c-0eb1698f917e service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:14:54.692574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1200/2424] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:14:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:14:59.431298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c47c1-d41d-4981-8548-c629e62fc73f None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:14:59.431776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c47c1-d41d-4981-8548-c629e62fc73f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:14:59.431878 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c47c1-d41d-4981-8548-c629e62fc73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:14:59.451466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a13c47c1-d41d-4981-8548-c629e62fc73f None None] MFA Rules not processed for user `80ab8a36909341869be8db4c103c4059`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:14:59.452666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a13c47c1-d41d-4981-8548-c629e62fc73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:14:59.459694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1225/2425] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:14:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:04.682986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=34 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:06.794100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8063c-e46d-48e1-b80c-0eb1698f917e service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:06.809964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8063c-e46d-48e1-b80c-0eb1698f917e service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:06.816554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b467-4b8b-408b-a8bb-5cf55a0010c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:06.817402 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b467-4b8b-408b-a8bb-5cf55a0010c8 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:06.817749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b467-4b8b-408b-a8bb-5cf55a0010c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:06.818022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b467-4b8b-408b-a8bb-5cf55a0010c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:06.820115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-de12b467-4b8b-408b-a8bb-5cf55a0010c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:06.838999 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12b467-4b8b-408b-a8bb-5cf55a0010c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:06.840594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12b467-4b8b-408b-a8bb-5cf55a0010c8 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:06.853542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1201/2426] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:07.569804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c47c1-d41d-4981-8548-c629e62fc73f None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:07.579337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c47c1-d41d-4981-8548-c629e62fc73f None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:07.582915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f0b93-ed7c-46cd-9171-064d24feb803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:07.583510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f0b93-ed7c-46cd-9171-064d24feb803 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:07.583786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f0b93-ed7c-46cd-9171-064d24feb803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:07.584052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f0b93-ed7c-46cd-9171-064d24feb803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:07.585775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-195f0b93-ed7c-46cd-9171-064d24feb803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:07.647541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f0b93-ed7c-46cd-9171-064d24feb803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:07.648995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f0b93-ed7c-46cd-9171-064d24feb803 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:07.658627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1226/2427] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:10.632699 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b467-4b8b-408b-a8bb-5cf55a0010c8 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:10.644410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b467-4b8b-408b-a8bb-5cf55a0010c8 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:10.649815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2057be0-c44d-4275-8ea1-c36807f716ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:10.650616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2057be0-c44d-4275-8ea1-c36807f716ea service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:10.650895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2057be0-c44d-4275-8ea1-c36807f716ea service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:10.651167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2057be0-c44d-4275-8ea1-c36807f716ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:10.652972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d2057be0-c44d-4275-8ea1-c36807f716ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:10.667034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2057be0-c44d-4275-8ea1-c36807f716ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:10.668888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2057be0-c44d-4275-8ea1-c36807f716ea service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:10.689696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1202/2428] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:10.701700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f0b93-ed7c-46cd-9171-064d24feb803 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:10.703891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-195f0b93-ed7c-46cd-9171-064d24feb803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:10.713555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=46 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:10.724814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f0b93-ed7c-46cd-9171-064d24feb803 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:10.730270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:10.730778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:10.731059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:10.731334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] PATH_INFO: `/v3/users/c88a4ae446ac43b48ee778344caec88c` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:10.732536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88a4ae446ac43b48ee778344caec88c)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:10.734526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:10.784085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88a4ae446ac43b48ee778344caec88c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:10.784745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88a4ae446ac43b48ee778344caec88c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:10.793036 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88a4ae446ac43b48ee778344caec88c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:10.807454 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88a4ae446ac43b48ee778344caec88c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:10.808175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a445b447-0207-49d6-bf64-868588f0ce57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88a4ae446ac43b48ee778344caec88c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:10.821160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1227/2429] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:10 2022] DELETE /identity/v3/users/c88a4ae446ac43b48ee778344caec88c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:10.993857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2057be0-c44d-4275-8ea1-c36807f716ea service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.021092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2057be0-c44d-4275-8ea1-c36807f716ea service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.083692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.084338 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.084616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.084887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] PATH_INFO: `/v3/projects/e71f921f6fd64a0ab71fc936d199854a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.086040 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71f921f6fd64a0ab71fc936d199854a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:11.088023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:11.137249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71f921f6fd64a0ab71fc936d199854a', 'request_id': 'req-1890d8f1-cec8-4429-aa5e-db7457e25c4c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:11.142707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71f921f6fd64a0ab71fc936d199854a', 'request_id': 'req-1890d8f1-cec8-4429-aa5e-db7457e25c4c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:11.149273 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71f921f6fd64a0ab71fc936d199854a', 'request_id': 'req-1890d8f1-cec8-4429-aa5e-db7457e25c4c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:11.161964 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] The token cache is being invalidate because project e71f921f6fd64a0ab71fc936d199854a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:11.162252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:11.162996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1890d8f1-cec8-4429-aa5e-db7457e25c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:11.164508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1203/2430] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:10 2022] DELETE /identity/v3/projects/e71f921f6fd64a0ab71fc936d199854a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:11.169542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484b667-6ccf-476c-895a-e41f9720d768 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.169776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484b667-6ccf-476c-895a-e41f9720d768 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.170056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484b667-6ccf-476c-895a-e41f9720d768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.192529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4484b667-6ccf-476c-895a-e41f9720d768 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:11.193745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4484b667-6ccf-476c-895a-e41f9720d768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:11.256013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1228/2431] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:15:11.264428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51ee7-f9d7-461a-9f49-cceff559de02 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.264772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51ee7-f9d7-461a-9f49-cceff559de02 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.265060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51ee7-f9d7-461a-9f49-cceff559de02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.292126 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e9a51ee7-f9d7-461a-9f49-cceff559de02 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:11.293371 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e9a51ee7-f9d7-461a-9f49-cceff559de02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:11.302211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1204/2432] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:11.306866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484b667-6ccf-476c-895a-e41f9720d768 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.317342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484b667-6ccf-476c-895a-e41f9720d768 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.322099 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7594c-bf7b-4a3b-a87d-8c5ab3106ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.322837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7594c-bf7b-4a3b-a87d-8c5ab3106ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.323115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7594c-bf7b-4a3b-a87d-8c5ab3106ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.323389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7594c-bf7b-4a3b-a87d-8c5ab3106ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.324089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7594c-bf7b-4a3b-a87d-8c5ab3106ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:15:11.324390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7594c-bf7b-4a3b-a87d-8c5ab3106ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:11.326021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7594c-bf7b-4a3b-a87d-8c5ab3106ce5 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:11.338348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1229/2433] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:15:11.343410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51ee7-f9d7-461a-9f49-cceff559de02 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.353310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51ee7-f9d7-461a-9f49-cceff559de02 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.358064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aeaa4-93f4-4e00-9956-f333e0aafa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.358785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aeaa4-93f4-4e00-9956-f333e0aafa5c admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.359067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aeaa4-93f4-4e00-9956-f333e0aafa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.359344 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aeaa4-93f4-4e00-9956-f333e0aafa5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.360009 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38aeaa4-93f4-4e00-9956-f333e0aafa5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:11.361920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38aeaa4-93f4-4e00-9956-f333e0aafa5c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:11.404080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1205/2434] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:11 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:15:11.405312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7594c-bf7b-4a3b-a87d-8c5ab3106ce5 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.416044 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7594c-bf7b-4a3b-a87d-8c5ab3106ce5 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.479747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad4176-b3a6-4d35-8b47-dedce2764edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.480371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad4176-b3a6-4d35-8b47-dedce2764edb admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.480650 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad4176-b3a6-4d35-8b47-dedce2764edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.480926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad4176-b3a6-4d35-8b47-dedce2764edb admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.481604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad4176-b3a6-4d35-8b47-dedce2764edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:11.483645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad4176-b3a6-4d35-8b47-dedce2764edb admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:11.493220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:11.507272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1230/2435] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:11 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:15:11.511328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aeaa4-93f4-4e00-9956-f333e0aafa5c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.521568 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aeaa4-93f4-4e00-9956-f333e0aafa5c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.526128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380ca8f-b444-4c42-b0a5-e9090369733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.526753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380ca8f-b444-4c42-b0a5-e9090369733c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.527033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380ca8f-b444-4c42-b0a5-e9090369733c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.527301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380ca8f-b444-4c42-b0a5-e9090369733c admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.528022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380ca8f-b444-4c42-b0a5-e9090369733c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:11.529607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380ca8f-b444-4c42-b0a5-e9090369733c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:11.539915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1206/2436] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:11.543914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad4176-b3a6-4d35-8b47-dedce2764edb admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.554355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad4176-b3a6-4d35-8b47-dedce2764edb admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.558985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd019578-25f8-41d7-89d0-a7996f5e94d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.559580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd019578-25f8-41d7-89d0-a7996f5e94d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.559854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd019578-25f8-41d7-89d0-a7996f5e94d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.560122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd019578-25f8-41d7-89d0-a7996f5e94d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.560816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd019578-25f8-41d7-89d0-a7996f5e94d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:11.562394 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd019578-25f8-41d7-89d0-a7996f5e94d6 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:11.573026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1231/2437] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:11.577193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380ca8f-b444-4c42-b0a5-e9090369733c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.588385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380ca8f-b444-4c42-b0a5-e9090369733c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.593817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e5171-0bdd-4620-abc6-81422aaddb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.594528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5171-0bdd-4620-abc6-81422aaddb86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.594814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5171-0bdd-4620-abc6-81422aaddb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.595118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5171-0bdd-4620-abc6-81422aaddb86 admin admin] PATH_INFO: `/v3/projects/6a90a671af78417bb69ac4de05eaad43/users/3f4909c887ba409d9d32b1d7dc63b57d/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.611913 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e5171-0bdd-4620-abc6-81422aaddb86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a90a671af78417bb69ac4de05eaad43, user_id=3f4909c887ba409d9d32b1d7dc63b57d, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:11.614661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e5171-0bdd-4620-abc6-81422aaddb86 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:11.624739 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:11.630556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1207/2438] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:11 2022] PUT /identity/v3/projects/6a90a671af78417bb69ac4de05eaad43/users/3f4909c887ba409d9d32b1d7dc63b57d/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:11.641129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10cdb-707a-4063-b306-83436909222e None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.641419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10cdb-707a-4063-b306-83436909222e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.641699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10cdb-707a-4063-b306-83436909222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.671245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-9cf10cdb-707a-4063-b306-83436909222e None None] MFA Rules not processed for user `3f4909c887ba409d9d32b1d7dc63b57d`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:11.672482 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9cf10cdb-707a-4063-b306-83436909222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:11.737611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1232/2439] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:11.742070 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e5171-0bdd-4620-abc6-81422aaddb86 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.804145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e5171-0bdd-4620-abc6-81422aaddb86 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.808826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9b8cb-57b6-43ed-8989-ae1c86126bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.809438 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9b8cb-57b6-43ed-8989-ae1c86126bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.809720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9b8cb-57b6-43ed-8989-ae1c86126bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.809994 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9b8cb-57b6-43ed-8989-ae1c86126bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.810693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9b8cb-57b6-43ed-8989-ae1c86126bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:11.812596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9b8cb-57b6-43ed-8989-ae1c86126bd2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:11.840606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1208/2440] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:11 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:11.844382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf10cdb-707a-4063-b306-83436909222e None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.858367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf10cdb-707a-4063-b306-83436909222e None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.914449 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bf4e5-13df-475e-aac0-65c246851294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.915090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf4e5-13df-475e-aac0-65c246851294 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.915372 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf4e5-13df-475e-aac0-65c246851294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.915648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf4e5-13df-475e-aac0-65c246851294 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.916315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bf4e5-13df-475e-aac0-65c246851294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:11.918239 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bf4e5-13df-475e-aac0-65c246851294 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:11.939104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1233/2441] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:11 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:11.943615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9b8cb-57b6-43ed-8989-ae1c86126bd2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.953933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9b8cb-57b6-43ed-8989-ae1c86126bd2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.959174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ca2f5-a409-4a4a-b7a1-3df8674500aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.959764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca2f5-a409-4a4a-b7a1-3df8674500aa admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.960044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca2f5-a409-4a4a-b7a1-3df8674500aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.960315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca2f5-a409-4a4a-b7a1-3df8674500aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:11.961008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ca2f5-a409-4a4a-b7a1-3df8674500aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:11.962651 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ca2f5-a409-4a4a-b7a1-3df8674500aa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:11.973247 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1209/2442] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:11.977420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bf4e5-13df-475e-aac0-65c246851294 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:11.988125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bf4e5-13df-475e-aac0-65c246851294 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:11.995202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f30ec1-29e4-48c3-8df5-aea1f34f590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:11.995898 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30ec1-29e4-48c3-8df5-aea1f34f590c admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:11.996184 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30ec1-29e4-48c3-8df5-aea1f34f590c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:11.996458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30ec1-29e4-48c3-8df5-aea1f34f590c admin admin] PATH_INFO: `/v3/projects/43633d191acc43c585d86bd0f4796866/users/d4819622108d42fcb4692af8a96b7674/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:12.012057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f30ec1-29e4-48c3-8df5-aea1f34f590c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43633d191acc43c585d86bd0f4796866, user_id=d4819622108d42fcb4692af8a96b7674, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:12.014809 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f30ec1-29e4-48c3-8df5-aea1f34f590c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:12.028075 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1234/2443] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:11 2022] PUT /identity/v3/projects/43633d191acc43c585d86bd0f4796866/users/d4819622108d42fcb4692af8a96b7674/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:12.032014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ca2f5-a409-4a4a-b7a1-3df8674500aa admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:12.041944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ca2f5-a409-4a4a-b7a1-3df8674500aa admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:12.096882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70600597-0e0a-4265-9da3-7b51f36b6329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:12.097491 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70600597-0e0a-4265-9da3-7b51f36b6329 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:12.097799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70600597-0e0a-4265-9da3-7b51f36b6329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:12.098073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70600597-0e0a-4265-9da3-7b51f36b6329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:12.098794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70600597-0e0a-4265-9da3-7b51f36b6329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:12.100393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70600597-0e0a-4265-9da3-7b51f36b6329 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:12.109836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1210/2444] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:12.113925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f30ec1-29e4-48c3-8df5-aea1f34f590c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:12.124041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f30ec1-29e4-48c3-8df5-aea1f34f590c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:12.128571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b0498-4976-4e33-8ff1-f7e82e3f6196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:12.129710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b0498-4976-4e33-8ff1-f7e82e3f6196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:12.129984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b0498-4976-4e33-8ff1-f7e82e3f6196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:12.130253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b0498-4976-4e33-8ff1-f7e82e3f6196 admin admin] PATH_INFO: `/v3/projects/43633d191acc43c585d86bd0f4796866/users/d4819622108d42fcb4692af8a96b7674/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:12.132242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b0498-4976-4e33-8ff1-f7e82e3f6196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43633d191acc43c585d86bd0f4796866, user_id=d4819622108d42fcb4692af8a96b7674, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:12.134930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b0498-4976-4e33-8ff1-f7e82e3f6196 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:12.145503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1235/2445] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:12 2022] PUT /identity/v3/projects/43633d191acc43c585d86bd0f4796866/users/d4819622108d42fcb4692af8a96b7674/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:12.161200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef680-24c2-4e19-9036-168a4549a76c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:12.161468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef680-24c2-4e19-9036-168a4549a76c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:12.161766 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef680-24c2-4e19-9036-168a4549a76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:12.189876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-07fef680-24c2-4e19-9036-168a4549a76c None None] MFA Rules not processed for user `d4819622108d42fcb4692af8a96b7674`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:12.191109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-07fef680-24c2-4e19-9036-168a4549a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:12.252798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:12.267428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1211/2446] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:15:12.275596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b0498-4976-4e33-8ff1-f7e82e3f6196 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:12.277288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-139b0498-4976-4e33-8ff1-f7e82e3f6196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:12.306156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:12.339453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b0498-4976-4e33-8ff1-f7e82e3f6196 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:12.343094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ff01a-508d-4818-9670-1f62499989e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:12.343703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ff01a-508d-4818-9670-1f62499989e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:12.343983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ff01a-508d-4818-9670-1f62499989e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:12.344256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ff01a-508d-4818-9670-1f62499989e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:12.353383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ff01a-508d-4818-9670-1f62499989e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:12.354911 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ff01a-508d-4818-9670-1f62499989e3 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:12.365109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1236/2447] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:12.439268 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fef680-24c2-4e19-9036-168a4549a76c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:12.449404 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fef680-24c2-4e19-9036-168a4549a76c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:12.453048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686221a0-42f6-4205-b73a-d81a4eec6da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:12.453654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686221a0-42f6-4205-b73a-d81a4eec6da5 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:12.453934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686221a0-42f6-4205-b73a-d81a4eec6da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:12.454208 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686221a0-42f6-4205-b73a-d81a4eec6da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:12.510579 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686221a0-42f6-4205-b73a-d81a4eec6da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:12.511945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686221a0-42f6-4205-b73a-d81a4eec6da5 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:12.520794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1212/2448] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:19.525208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ff01a-508d-4818-9670-1f62499989e3 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:19.587420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ff01a-508d-4818-9670-1f62499989e3 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:19.592106 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:19.592734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:19.593016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:19.593297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] PATH_INFO: `/v3/users/3f4909c887ba409d9d32b1d7dc63b57d` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:19.594466 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4909c887ba409d9d32b1d7dc63b57d)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:19.596431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:19.641859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4909c887ba409d9d32b1d7dc63b57d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:19.642430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4909c887ba409d9d32b1d7dc63b57d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:19.649308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4909c887ba409d9d32b1d7dc63b57d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:19.661455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4909c887ba409d9d32b1d7dc63b57d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:19.662079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4909c887ba409d9d32b1d7dc63b57d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:19.674077 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1237/2449] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:19 2022] DELETE /identity/v3/users/3f4909c887ba409d9d32b1d7dc63b57d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:19.679190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd8fe-0872-49a6-ad33-9c30818b7f84 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:19.679704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd8fe-0872-49a6-ad33-9c30818b7f84 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:19.679704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd8fe-0872-49a6-ad33-9c30818b7f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:19.698238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4c8dd8fe-0872-49a6-ad33-9c30818b7f84 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:19.699459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4c8dd8fe-0872-49a6-ad33-9c30818b7f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:19.758271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1213/2450] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:19.767892 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:19.769300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:19.817781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:19.829712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a5bc-eab9-4555-9e18-737ef494d326 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:19.833915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0282e-3b44-4e53-8262-0dc9eff3de2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:19.834559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0282e-3b44-4e53-8262-0dc9eff3de2f service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:19.834881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0282e-3b44-4e53-8262-0dc9eff3de2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:19.835119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0282e-3b44-4e53-8262-0dc9eff3de2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:19.844061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0282e-3b44-4e53-8262-0dc9eff3de2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:19.845487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0282e-3b44-4e53-8262-0dc9eff3de2f service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:19.855559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1238/2451] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:20.121683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dd8fe-0872-49a6-ad33-9c30818b7f84 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:20.123213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4c8dd8fe-0872-49a6-ad33-9c30818b7f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:20.136322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dd8fe-0872-49a6-ad33-9c30818b7f84 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:20.141095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:20.142415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:20.142843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:20.143134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] PATH_INFO: `/v3/projects/6a90a671af78417bb69ac4de05eaad43` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:20.144843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a90a671af78417bb69ac4de05eaad43)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:20.146880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:20.196445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a90a671af78417bb69ac4de05eaad43', 'request_id': 'req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.201837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a90a671af78417bb69ac4de05eaad43', 'request_id': 'req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.208586 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a90a671af78417bb69ac4de05eaad43', 'request_id': 'req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.221668 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] The token cache is being invalidate because project 6a90a671af78417bb69ac4de05eaad43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:20.221953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.223109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.224698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1214/2452] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:20 2022] DELETE /identity/v3/projects/6a90a671af78417bb69ac4de05eaad43 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:20.228860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0282e-3b44-4e53-8262-0dc9eff3de2f service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:20.239128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0282e-3b44-4e53-8262-0dc9eff3de2f service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:20.293855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:20.294506 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:20.294785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:20.295056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] PATH_INFO: `/v3/users/d4819622108d42fcb4692af8a96b7674` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:20.296190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4819622108d42fcb4692af8a96b7674)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:20.298111 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:20.342805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4819622108d42fcb4692af8a96b7674'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.343449 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4819622108d42fcb4692af8a96b7674'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.350997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4819622108d42fcb4692af8a96b7674'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.363098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4819622108d42fcb4692af8a96b7674'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.364257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e47313c4-7919-46e1-a956-13f097a8fbe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4819622108d42fcb4692af8a96b7674'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.376154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1239/2453] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:20 2022] DELETE /identity/v3/users/d4819622108d42fcb4692af8a96b7674 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:20.647684 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:20.649118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:20.664733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74346b1-2d46-4c5d-8f5f-d7c9865313cb admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:20.678417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:20.728318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:20.728899 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:20.729181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:20.729458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] PATH_INFO: `/v3/projects/43633d191acc43c585d86bd0f4796866` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:20.730656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43633d191acc43c585d86bd0f4796866)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:20.732600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:20.777306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43633d191acc43c585d86bd0f4796866', 'request_id': 'req-2a98394a-5aa4-4ea2-b431-88f74fd67a61'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.782819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43633d191acc43c585d86bd0f4796866', 'request_id': 'req-2a98394a-5aa4-4ea2-b431-88f74fd67a61'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.789566 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43633d191acc43c585d86bd0f4796866', 'request_id': 'req-2a98394a-5aa4-4ea2-b431-88f74fd67a61'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.801795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] The token cache is being invalidate because project 43633d191acc43c585d86bd0f4796866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:20.802075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.802711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2a98394a-5aa4-4ea2-b431-88f74fd67a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:20.804196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1215/2454] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:20 2022] DELETE /identity/v3/projects/43633d191acc43c585d86bd0f4796866 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:20.809221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86928320-5414-4d07-ab17-71567bbf8ac9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:20.809718 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86928320-5414-4d07-ab17-71567bbf8ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:20.809816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86928320-5414-4d07-ab17-71567bbf8ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:20.830220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-86928320-5414-4d07-ab17-71567bbf8ac9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:20.831449 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-86928320-5414-4d07-ab17-71567bbf8ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:20.890464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1240/2455] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:20.898209 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ae647-3a42-4ea3-9645-d378767c2b17 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:20.898517 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ae647-3a42-4ea3-9645-d378767c2b17 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:20.898791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ae647-3a42-4ea3-9645-d378767c2b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:20.922449 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8e2ae647-3a42-4ea3-9645-d378767c2b17 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:20.923687 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8e2ae647-3a42-4ea3-9645-d378767c2b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:20.932334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1216/2456] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:20.936516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86928320-5414-4d07-ab17-71567bbf8ac9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:20.946967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86928320-5414-4d07-ab17-71567bbf8ac9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:20.951602 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15793f-a995-4643-bcdf-1cf33cce8f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:20.952208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15793f-a995-4643-bcdf-1cf33cce8f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:20.952486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15793f-a995-4643-bcdf-1cf33cce8f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:20.952759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15793f-a995-4643-bcdf-1cf33cce8f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:20.953484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15793f-a995-4643-bcdf-1cf33cce8f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:15:20.953796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15793f-a995-4643-bcdf-1cf33cce8f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:20.955426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15793f-a995-4643-bcdf-1cf33cce8f78 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:20.956947 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:20.969037 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1241/2457] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 02:15:20.973060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ae647-3a42-4ea3-9645-d378767c2b17 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:20.982427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ae647-3a42-4ea3-9645-d378767c2b17 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:20.987062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be6315-3d25-4816-adf9-8db8d3f5c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:20.987657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be6315-3d25-4816-adf9-8db8d3f5c0bd admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:20.987938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be6315-3d25-4816-adf9-8db8d3f5c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:20.988211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be6315-3d25-4816-adf9-8db8d3f5c0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:20.988862 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be6315-3d25-4816-adf9-8db8d3f5c0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:20.990816 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be6315-3d25-4816-adf9-8db8d3f5c0bd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.017693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1217/2458] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:20 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:21.022084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15793f-a995-4643-bcdf-1cf33cce8f78 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.032174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15793f-a995-4643-bcdf-1cf33cce8f78 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.088022 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f8831-950d-4d44-af0c-6ec9b8a8f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.088632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f8831-950d-4d44-af0c-6ec9b8a8f384 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.088914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f8831-950d-4d44-af0c-6ec9b8a8f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.089193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f8831-950d-4d44-af0c-6ec9b8a8f384 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.089856 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f8831-950d-4d44-af0c-6ec9b8a8f384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.091816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f8831-950d-4d44-af0c-6ec9b8a8f384 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.115232 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1242/2459] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:21 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:21.119094 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be6315-3d25-4816-adf9-8db8d3f5c0bd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.129898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be6315-3d25-4816-adf9-8db8d3f5c0bd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.134644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b38ad9-36f3-4fc8-ae75-a8f45ce0aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.135249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b38ad9-36f3-4fc8-ae75-a8f45ce0aae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.135533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b38ad9-36f3-4fc8-ae75-a8f45ce0aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.135809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b38ad9-36f3-4fc8-ae75-a8f45ce0aae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.136499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b38ad9-36f3-4fc8-ae75-a8f45ce0aae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.138117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b38ad9-36f3-4fc8-ae75-a8f45ce0aae2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.149034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1218/2460] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:21.153073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f8831-950d-4d44-af0c-6ec9b8a8f384 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.163166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f8831-950d-4d44-af0c-6ec9b8a8f384 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.168226 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bd0dd-c582-405c-a6e0-32d6e63445b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.168827 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bd0dd-c582-405c-a6e0-32d6e63445b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.169109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bd0dd-c582-405c-a6e0-32d6e63445b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.169749 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bd0dd-c582-405c-a6e0-32d6e63445b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.170477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bd0dd-c582-405c-a6e0-32d6e63445b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.172085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bd0dd-c582-405c-a6e0-32d6e63445b3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.182845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1243/2461] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:21.186839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b38ad9-36f3-4fc8-ae75-a8f45ce0aae2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.197628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b38ad9-36f3-4fc8-ae75-a8f45ce0aae2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.202258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f539a-ff61-4b8c-9558-c0c227b0c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.202971 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f539a-ff61-4b8c-9558-c0c227b0c84e admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.203254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f539a-ff61-4b8c-9558-c0c227b0c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.203527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f539a-ff61-4b8c-9558-c0c227b0c84e admin admin] PATH_INFO: `/v3/projects/fb95ca60beab424b8b10cd7730f17725/users/c4c40b247e0140caa02fafe68515f715/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.218630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f539a-ff61-4b8c-9558-c0c227b0c84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb95ca60beab424b8b10cd7730f17725, user_id=c4c40b247e0140caa02fafe68515f715, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.221291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f539a-ff61-4b8c-9558-c0c227b0c84e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.233771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1219/2462] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:21 2022] PUT /identity/v3/projects/fb95ca60beab424b8b10cd7730f17725/users/c4c40b247e0140caa02fafe68515f715/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:15:21.246421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559556-63e0-4807-b70e-e1fd040f1dd3 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.246767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559556-63e0-4807-b70e-e1fd040f1dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.247044 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559556-63e0-4807-b70e-e1fd040f1dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.276688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-b7559556-63e0-4807-b70e-e1fd040f1dd3 None None] MFA Rules not processed for user `c4c40b247e0140caa02fafe68515f715`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:21.277894 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b7559556-63e0-4807-b70e-e1fd040f1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:21.340732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1244/2463] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:21.345368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f539a-ff61-4b8c-9558-c0c227b0c84e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.390987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:21.407927 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f539a-ff61-4b8c-9558-c0c227b0c84e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.412528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cfa3e-00cb-4a25-918e-cf698563a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.413138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cfa3e-00cb-4a25-918e-cf698563a615 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.413413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cfa3e-00cb-4a25-918e-cf698563a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.413685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cfa3e-00cb-4a25-918e-cf698563a615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.414364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cfa3e-00cb-4a25-918e-cf698563a615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.416310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cfa3e-00cb-4a25-918e-cf698563a615 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.442681 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1220/2464] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:21 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:21.446748 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7559556-63e0-4807-b70e-e1fd040f1dd3 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.457448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7559556-63e0-4807-b70e-e1fd040f1dd3 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.513964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36521-e033-4845-aa1f-9e93740f8312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.514533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36521-e033-4845-aa1f-9e93740f8312 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.514814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36521-e033-4845-aa1f-9e93740f8312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.515087 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36521-e033-4845-aa1f-9e93740f8312 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.515743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36521-e033-4845-aa1f-9e93740f8312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.517680 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36521-e033-4845-aa1f-9e93740f8312 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.526459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:21.538485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1245/2465] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:21 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:21.542457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cfa3e-00cb-4a25-918e-cf698563a615 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.553128 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cfa3e-00cb-4a25-918e-cf698563a615 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.557665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebd172-a026-43cb-9e0e-69027c7a7fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.558262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebd172-a026-43cb-9e0e-69027c7a7fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.558569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebd172-a026-43cb-9e0e-69027c7a7fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.558839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebd172-a026-43cb-9e0e-69027c7a7fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.559524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebd172-a026-43cb-9e0e-69027c7a7fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.561131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebd172-a026-43cb-9e0e-69027c7a7fe3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.572543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1221/2466] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:21.576492 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36521-e033-4845-aa1f-9e93740f8312 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.586469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36521-e033-4845-aa1f-9e93740f8312 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.592201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01889a3-be56-401a-9473-7a256900b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.593032 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01889a3-be56-401a-9473-7a256900b7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.593309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01889a3-be56-401a-9473-7a256900b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.593577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01889a3-be56-401a-9473-7a256900b7d0 admin admin] PATH_INFO: `/v3/projects/c7f0d1f92b1e4a0c9cf19100bafb6c45/users/32e4d4af981540788fc2ccbabb8bf4da/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.609418 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01889a3-be56-401a-9473-7a256900b7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f0d1f92b1e4a0c9cf19100bafb6c45, user_id=32e4d4af981540788fc2ccbabb8bf4da, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.612112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01889a3-be56-401a-9473-7a256900b7d0 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.625822 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1246/2467] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:21 2022] PUT /identity/v3/projects/c7f0d1f92b1e4a0c9cf19100bafb6c45/users/32e4d4af981540788fc2ccbabb8bf4da/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:21.629836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebd172-a026-43cb-9e0e-69027c7a7fe3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.640351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebd172-a026-43cb-9e0e-69027c7a7fe3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.695666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a2a1b-14f8-4e60-900a-9d6f858f55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.696274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2a1b-14f8-4e60-900a-9d6f858f55b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.696554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2a1b-14f8-4e60-900a-9d6f858f55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.696824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2a1b-14f8-4e60-900a-9d6f858f55b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.697510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a2a1b-14f8-4e60-900a-9d6f858f55b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.699146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a2a1b-14f8-4e60-900a-9d6f858f55b7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.709512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1222/2468] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:21.713730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01889a3-be56-401a-9473-7a256900b7d0 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.724571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01889a3-be56-401a-9473-7a256900b7d0 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.729338 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ef91e-dbd1-4864-a249-6d2d6f6a9e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.730016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ef91e-dbd1-4864-a249-6d2d6f6a9e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.730296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ef91e-dbd1-4864-a249-6d2d6f6a9e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.730606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ef91e-dbd1-4864-a249-6d2d6f6a9e34 admin admin] PATH_INFO: `/v3/projects/c7f0d1f92b1e4a0c9cf19100bafb6c45/users/32e4d4af981540788fc2ccbabb8bf4da/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.732556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ef91e-dbd1-4864-a249-6d2d6f6a9e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f0d1f92b1e4a0c9cf19100bafb6c45, user_id=32e4d4af981540788fc2ccbabb8bf4da, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.735284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ef91e-dbd1-4864-a249-6d2d6f6a9e34 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.745979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1247/2469] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:21 2022] PUT /identity/v3/projects/c7f0d1f92b1e4a0c9cf19100bafb6c45/users/32e4d4af981540788fc2ccbabb8bf4da/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:21.755783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd030c8-b5cc-4007-94be-9949e1d97463 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.756253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd030c8-b5cc-4007-94be-9949e1d97463 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.756358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd030c8-b5cc-4007-94be-9949e1d97463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.783316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8bd030c8-b5cc-4007-94be-9949e1d97463 None None] MFA Rules not processed for user `32e4d4af981540788fc2ccbabb8bf4da`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:21.784442 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8bd030c8-b5cc-4007-94be-9949e1d97463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:21.857916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1223/2470] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:21.870031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ef91e-dbd1-4864-a249-6d2d6f6a9e34 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:21.871859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-bb5ef91e-dbd1-4864-a249-6d2d6f6a9e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:21.931266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ef91e-dbd1-4864-a249-6d2d6f6a9e34 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:21.934948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da83f4d-9b77-4e48-8334-040a2b9089b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:21.935553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da83f4d-9b77-4e48-8334-040a2b9089b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:21.935829 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da83f4d-9b77-4e48-8334-040a2b9089b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:21.936106 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da83f4d-9b77-4e48-8334-040a2b9089b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:21.945712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da83f4d-9b77-4e48-8334-040a2b9089b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:21.947192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da83f4d-9b77-4e48-8334-040a2b9089b8 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:21.959370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1248/2471] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:23.432436 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd030c8-b5cc-4007-94be-9949e1d97463 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:23.475237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:23.495773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd030c8-b5cc-4007-94be-9949e1d97463 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:23.500282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:23.500918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:23.501197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:23.501471 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] PATH_INFO: `/v3/users/c4c40b247e0140caa02fafe68515f715` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:23.502658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c40b247e0140caa02fafe68515f715)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:23.505110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:23.551517 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c40b247e0140caa02fafe68515f715'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:23.552168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c40b247e0140caa02fafe68515f715'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:23.560147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c40b247e0140caa02fafe68515f715'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:23.572847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c40b247e0140caa02fafe68515f715'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:23.573466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c40b247e0140caa02fafe68515f715'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:23.585205 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1224/2472] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:23 2022] DELETE /identity/v3/users/c4c40b247e0140caa02fafe68515f715 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:23.589725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36fe3e-f5e0-4161-9fc4-40bf278b62ac None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:23.590196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36fe3e-f5e0-4161-9fc4-40bf278b62ac None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:23.590312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36fe3e-f5e0-4161-9fc4-40bf278b62ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:23.608421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-5f36fe3e-f5e0-4161-9fc4-40bf278b62ac None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:23.609537 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-5f36fe3e-f5e0-4161-9fc4-40bf278b62ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:23.666129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1249/2473] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:23.676250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:23.677714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:23.733990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ea8d0-39c5-4925-af3b-a8f8020ec4b9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:23.737626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f579c-cd76-418c-aacb-100a5d63070c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:23.738796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f579c-cd76-418c-aacb-100a5d63070c service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:23.739074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f579c-cd76-418c-aacb-100a5d63070c service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:23.739343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f579c-cd76-418c-aacb-100a5d63070c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:23.748146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f579c-cd76-418c-aacb-100a5d63070c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:23.749561 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f579c-cd76-418c-aacb-100a5d63070c service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:23.759549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1225/2474] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:24.025150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36fe3e-f5e0-4161-9fc4-40bf278b62ac None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:24.026620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-5f36fe3e-f5e0-4161-9fc4-40bf278b62ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:24.039899 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36fe3e-f5e0-4161-9fc4-40bf278b62ac None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:24.044605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:24.045241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:24.045521 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:24.045800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] PATH_INFO: `/v3/projects/fb95ca60beab424b8b10cd7730f17725` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:24.046987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb95ca60beab424b8b10cd7730f17725)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:24.048909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:24.095257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb95ca60beab424b8b10cd7730f17725', 'request_id': 'req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.098281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:24.103031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb95ca60beab424b8b10cd7730f17725', 'request_id': 'req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.114230 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb95ca60beab424b8b10cd7730f17725', 'request_id': 'req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.125534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] The token cache is being invalidate because project fb95ca60beab424b8b10cd7730f17725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:24.125534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.126125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.127652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1250/2475] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:24 2022] DELETE /identity/v3/projects/fb95ca60beab424b8b10cd7730f17725 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:24.131589 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f579c-cd76-418c-aacb-100a5d63070c service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:24.141181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f579c-cd76-418c-aacb-100a5d63070c service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:24.197673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:24.198314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:24.198634 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:24.198906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] PATH_INFO: `/v3/users/32e4d4af981540788fc2ccbabb8bf4da` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:24.200051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e4d4af981540788fc2ccbabb8bf4da)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:24.201947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:24.204319 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:24.248116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e4d4af981540788fc2ccbabb8bf4da'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.248752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e4d4af981540788fc2ccbabb8bf4da'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.256248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e4d4af981540788fc2ccbabb8bf4da'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.268189 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e4d4af981540788fc2ccbabb8bf4da'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.268887 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4690fb80-809e-4363-9840-83a2db17fda2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e4d4af981540788fc2ccbabb8bf4da'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.281633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1226/2476] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:24 2022] DELETE /identity/v3/users/32e4d4af981540788fc2ccbabb8bf4da => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:24.547363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:24.548810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:24.562185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d276d-bfa1-4b51-84b8-1db34780d1a3 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:24.619638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:24.620270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:24.620546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:24.620813 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] PATH_INFO: `/v3/projects/c7f0d1f92b1e4a0c9cf19100bafb6c45` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:24.622206 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f0d1f92b1e4a0c9cf19100bafb6c45)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:24.624414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:24.670342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f0d1f92b1e4a0c9cf19100bafb6c45', 'request_id': 'req-a597217f-9585-404d-bcef-97908a694813'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.678626 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f0d1f92b1e4a0c9cf19100bafb6c45', 'request_id': 'req-a597217f-9585-404d-bcef-97908a694813'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.684407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f0d1f92b1e4a0c9cf19100bafb6c45', 'request_id': 'req-a597217f-9585-404d-bcef-97908a694813'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.695585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] The token cache is being invalidate because project c7f0d1f92b1e4a0c9cf19100bafb6c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:24.695869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.696515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-a597217f-9585-404d-bcef-97908a694813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:24.698024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1251/2477] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:24 2022] DELETE /identity/v3/projects/c7f0d1f92b1e4a0c9cf19100bafb6c45 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:24.703078 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0cb64-a0cc-4118-84f8-736fd24b2f4a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:24.703549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0cb64-a0cc-4118-84f8-736fd24b2f4a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:24.703789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0cb64-a0cc-4118-84f8-736fd24b2f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:24.724306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-18b0cb64-a0cc-4118-84f8-736fd24b2f4a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:24.725525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-18b0cb64-a0cc-4118-84f8-736fd24b2f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:24.783151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1227/2478] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:24.791406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752adac-c9c9-4968-8a41-c6a667434185 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:24.791719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752adac-c9c9-4968-8a41-c6a667434185 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:24.791997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752adac-c9c9-4968-8a41-c6a667434185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:24.811832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f752adac-c9c9-4968-8a41-c6a667434185 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:24.813294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f752adac-c9c9-4968-8a41-c6a667434185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:24.821740 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1252/2479] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:24.825792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0cb64-a0cc-4118-84f8-736fd24b2f4a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:24.835410 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0cb64-a0cc-4118-84f8-736fd24b2f4a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:24.839957 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5e8ee-61f5-4688-9987-4940c9e19bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:24.840555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5e8ee-61f5-4688-9987-4940c9e19bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:24.840831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5e8ee-61f5-4688-9987-4940c9e19bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:24.841098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5e8ee-61f5-4688-9987-4940c9e19bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:24.841783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5e8ee-61f5-4688-9987-4940c9e19bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:15:24.842081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5e8ee-61f5-4688-9987-4940c9e19bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:24.843686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5e8ee-61f5-4688-9987-4940c9e19bf9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:24.855403 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1228/2480] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:15:24.859426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752adac-c9c9-4968-8a41-c6a667434185 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:24.869023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752adac-c9c9-4968-8a41-c6a667434185 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:24.873618 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5ade-486e-4b84-84c2-7a3475c5d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:24.874223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5ade-486e-4b84-84c2-7a3475c5d061 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:24.874530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5ade-486e-4b84-84c2-7a3475c5d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:24.874798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5ade-486e-4b84-84c2-7a3475c5d061 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:24.875463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a5ade-486e-4b84-84c2-7a3475c5d061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:24.877357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a5ade-486e-4b84-84c2-7a3475c5d061 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:24.903348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1253/2481] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:24 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:15:24.907419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5e8ee-61f5-4688-9987-4940c9e19bf9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:24.917652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5e8ee-61f5-4688-9987-4940c9e19bf9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:24.974149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c070f-2f79-4f71-b5c6-929a2f6dfa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:24.974783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c070f-2f79-4f71-b5c6-929a2f6dfa16 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:24.975058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c070f-2f79-4f71-b5c6-929a2f6dfa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:24.975337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c070f-2f79-4f71-b5c6-929a2f6dfa16 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:24.975980 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c070f-2f79-4f71-b5c6-929a2f6dfa16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:24.977908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c070f-2f79-4f71-b5c6-929a2f6dfa16 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:24.993244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:25.000373 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1229/2482] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:24 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:25.004953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5ade-486e-4b84-84c2-7a3475c5d061 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:25.015196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5ade-486e-4b84-84c2-7a3475c5d061 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:25.020596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4af40-a1d7-4797-b8c6-65c66f8067d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:25.021197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4af40-a1d7-4797-b8c6-65c66f8067d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.021480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4af40-a1d7-4797-b8c6-65c66f8067d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.021754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4af40-a1d7-4797-b8c6-65c66f8067d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.022530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4af40-a1d7-4797-b8c6-65c66f8067d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:25.024080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4af40-a1d7-4797-b8c6-65c66f8067d4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:25.033851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1254/2483] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:25.037608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c070f-2f79-4f71-b5c6-929a2f6dfa16 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:25.047412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c070f-2f79-4f71-b5c6-929a2f6dfa16 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:25.052458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcab03-f05e-4d1f-b18e-3496911849d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:25.053044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcab03-f05e-4d1f-b18e-3496911849d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.053321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcab03-f05e-4d1f-b18e-3496911849d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.053590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcab03-f05e-4d1f-b18e-3496911849d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.054270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcab03-f05e-4d1f-b18e-3496911849d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:25.055875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcab03-f05e-4d1f-b18e-3496911849d7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:25.066970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1230/2484] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:25.070849 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4af40-a1d7-4797-b8c6-65c66f8067d4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:25.080825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4af40-a1d7-4797-b8c6-65c66f8067d4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:25.085463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5741b0-e9ae-494c-b1ff-17c9dcc69d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:25.086109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5741b0-e9ae-494c-b1ff-17c9dcc69d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.086386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5741b0-e9ae-494c-b1ff-17c9dcc69d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.086693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5741b0-e9ae-494c-b1ff-17c9dcc69d17 admin admin] PATH_INFO: `/v3/projects/e55c24d1f025403794da5f7fc093a3da/users/dd9a9560dbea4e0eb749372d4cbce3d1/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.100914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5741b0-e9ae-494c-b1ff-17c9dcc69d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55c24d1f025403794da5f7fc093a3da, user_id=dd9a9560dbea4e0eb749372d4cbce3d1, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:25.103627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5741b0-e9ae-494c-b1ff-17c9dcc69d17 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:25.116850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1255/2485] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:25 2022] PUT /identity/v3/projects/e55c24d1f025403794da5f7fc093a3da/users/dd9a9560dbea4e0eb749372d4cbce3d1/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:25.127928 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8068b3-4fc9-44b2-bd34-77bfafee5dad None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.128212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8068b3-4fc9-44b2-bd34-77bfafee5dad None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.128484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8068b3-4fc9-44b2-bd34-77bfafee5dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.155523 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cc8068b3-4fc9-44b2-bd34-77bfafee5dad None None] MFA Rules not processed for user `dd9a9560dbea4e0eb749372d4cbce3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:25.156855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cc8068b3-4fc9-44b2-bd34-77bfafee5dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:25.220092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1231/2486] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:25.224689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5741b0-e9ae-494c-b1ff-17c9dcc69d17 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:25.233518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:25.288664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5741b0-e9ae-494c-b1ff-17c9dcc69d17 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:25.293294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febce5-c30b-4213-8d68-e7aff7e43e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:25.293900 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febce5-c30b-4213-8d68-e7aff7e43e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.294176 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febce5-c30b-4213-8d68-e7aff7e43e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.294470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febce5-c30b-4213-8d68-e7aff7e43e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.295127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04febce5-c30b-4213-8d68-e7aff7e43e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:25.297054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04febce5-c30b-4213-8d68-e7aff7e43e5d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:25.323095 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1256/2487] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:25 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:15:25.327086 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8068b3-4fc9-44b2-bd34-77bfafee5dad None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:25.337505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8068b3-4fc9-44b2-bd34-77bfafee5dad None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:25.392503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f17ec2-2cf9-4772-a634-d379afa92b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:25.393118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17ec2-2cf9-4772-a634-d379afa92b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.393394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17ec2-2cf9-4772-a634-d379afa92b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.393663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17ec2-2cf9-4772-a634-d379afa92b8e admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.394333 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f17ec2-2cf9-4772-a634-d379afa92b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:25.396300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f17ec2-2cf9-4772-a634-d379afa92b8e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:25.417401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1232/2488] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:25 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:25.421357 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febce5-c30b-4213-8d68-e7aff7e43e5d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:25.432469 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febce5-c30b-4213-8d68-e7aff7e43e5d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:25.437664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4f042-a447-44cf-9244-5808efa8f12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:25.438549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f042-a447-44cf-9244-5808efa8f12a admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.438855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f042-a447-44cf-9244-5808efa8f12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.439124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f042-a447-44cf-9244-5808efa8f12a admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.439815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4f042-a447-44cf-9244-5808efa8f12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:25.441390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4f042-a447-44cf-9244-5808efa8f12a admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:25.451675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1257/2489] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:25.455602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f17ec2-2cf9-4772-a634-d379afa92b8e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:25.465363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f17ec2-2cf9-4772-a634-d379afa92b8e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:25.469945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808c6b-ef2a-4e63-8a13-094b9a4063d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:25.470617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808c6b-ef2a-4e63-8a13-094b9a4063d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.471033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808c6b-ef2a-4e63-8a13-094b9a4063d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.471196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808c6b-ef2a-4e63-8a13-094b9a4063d5 admin admin] PATH_INFO: `/v3/projects/b738eaf9c4334d05928d96fdeabe76db/users/107496d907ca4796a824ee36297a2cbe/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.485920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa808c6b-ef2a-4e63-8a13-094b9a4063d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b738eaf9c4334d05928d96fdeabe76db, user_id=107496d907ca4796a824ee36297a2cbe, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:25.489096 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa808c6b-ef2a-4e63-8a13-094b9a4063d5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:25.501877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1233/2490] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:25 2022] PUT /identity/v3/projects/b738eaf9c4334d05928d96fdeabe76db/users/107496d907ca4796a824ee36297a2cbe/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:25.505651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4f042-a447-44cf-9244-5808efa8f12a admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:25.515457 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4f042-a447-44cf-9244-5808efa8f12a admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:25.570599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166e614-434f-4f2c-b3ad-8c62843a7496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:25.571197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e614-434f-4f2c-b3ad-8c62843a7496 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.571475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e614-434f-4f2c-b3ad-8c62843a7496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.571765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e614-434f-4f2c-b3ad-8c62843a7496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.572476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166e614-434f-4f2c-b3ad-8c62843a7496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:25.574228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166e614-434f-4f2c-b3ad-8c62843a7496 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:25.583898 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1258/2491] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:25.588011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808c6b-ef2a-4e63-8a13-094b9a4063d5 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:25.598741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808c6b-ef2a-4e63-8a13-094b9a4063d5 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:25.603399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40709aaf-d46b-4a73-9b63-239f59cbc9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:25.604048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709aaf-d46b-4a73-9b63-239f59cbc9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.604324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709aaf-d46b-4a73-9b63-239f59cbc9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.604594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709aaf-d46b-4a73-9b63-239f59cbc9ed admin admin] PATH_INFO: `/v3/projects/b738eaf9c4334d05928d96fdeabe76db/users/107496d907ca4796a824ee36297a2cbe/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.606577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40709aaf-d46b-4a73-9b63-239f59cbc9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b738eaf9c4334d05928d96fdeabe76db, user_id=107496d907ca4796a824ee36297a2cbe, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:25.609199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40709aaf-d46b-4a73-9b63-239f59cbc9ed admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:25.619848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1234/2492] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:25 2022] PUT /identity/v3/projects/b738eaf9c4334d05928d96fdeabe76db/users/107496d907ca4796a824ee36297a2cbe/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:25.630109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467b8d3-961c-42a6-9d68-614958ee8f89 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.630583 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467b8d3-961c-42a6-9d68-614958ee8f89 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.630694 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467b8d3-961c-42a6-9d68-614958ee8f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.658300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-2467b8d3-961c-42a6-9d68-614958ee8f89 None None] MFA Rules not processed for user `107496d907ca4796a824ee36297a2cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:25.659519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2467b8d3-961c-42a6-9d68-614958ee8f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:25.725986 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1259/2493] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:25.737203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40709aaf-d46b-4a73-9b63-239f59cbc9ed admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:25.738883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-40709aaf-d46b-4a73-9b63-239f59cbc9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:25.771866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:25.798104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40709aaf-d46b-4a73-9b63-239f59cbc9ed admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:25.802255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec464ac-ef4a-48ae-8f5b-45692d161528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:25.802892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec464ac-ef4a-48ae-8f5b-45692d161528 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:25.803175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec464ac-ef4a-48ae-8f5b-45692d161528 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:25.803446 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec464ac-ef4a-48ae-8f5b-45692d161528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:25.857038 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec464ac-ef4a-48ae-8f5b-45692d161528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:25.858490 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec464ac-ef4a-48ae-8f5b-45692d161528 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:25.869583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1235/2494] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:27.221312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467b8d3-961c-42a6-9d68-614958ee8f89 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:27.222804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2467b8d3-961c-42a6-9d68-614958ee8f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:27.229524 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:27.236053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467b8d3-961c-42a6-9d68-614958ee8f89 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:27.240551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964c0e8-bcc6-4933-a022-635f971b913c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:27.241157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964c0e8-bcc6-4933-a022-635f971b913c service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:27.241432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964c0e8-bcc6-4933-a022-635f971b913c service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:27.241789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964c0e8-bcc6-4933-a022-635f971b913c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:27.251261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964c0e8-bcc6-4933-a022-635f971b913c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:27.252704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964c0e8-bcc6-4933-a022-635f971b913c service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:27.262933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1260/2495] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:31.022067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec464ac-ef4a-48ae-8f5b-45692d161528 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:31.082413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec464ac-ef4a-48ae-8f5b-45692d161528 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:31.087482 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:31.088184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:31.088463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:31.088736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] PATH_INFO: `/v3/users/dd9a9560dbea4e0eb749372d4cbce3d1` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:31.089914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9a9560dbea4e0eb749372d4cbce3d1)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:31.091849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:31.136614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9a9560dbea4e0eb749372d4cbce3d1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.137188 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9a9560dbea4e0eb749372d4cbce3d1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.144404 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9a9560dbea4e0eb749372d4cbce3d1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.157883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9a9560dbea4e0eb749372d4cbce3d1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.158555 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9a9560dbea4e0eb749372d4cbce3d1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.171437 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1236/2496] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:31 2022] DELETE /identity/v3/users/dd9a9560dbea4e0eb749372d4cbce3d1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:31.176020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a0569-a176-4490-878a-73ebd530ea23 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:31.176516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a0569-a176-4490-878a-73ebd530ea23 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:31.176615 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a0569-a176-4490-878a-73ebd530ea23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:31.195501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-039a0569-a176-4490-878a-73ebd530ea23 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:31.196710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-039a0569-a176-4490-878a-73ebd530ea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:31.253277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1261/2497] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:31.262806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:31.264192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:31.269797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:31.324585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbef26-d0f5-414a-93b8-6e078ea0b963 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:31.328350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f14a6a-8735-4d93-8e11-bdab9e10e39b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:31.328968 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f14a6a-8735-4d93-8e11-bdab9e10e39b service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:31.329247 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f14a6a-8735-4d93-8e11-bdab9e10e39b service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:31.329521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f14a6a-8735-4d93-8e11-bdab9e10e39b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:31.340434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f14a6a-8735-4d93-8e11-bdab9e10e39b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:31.341869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f14a6a-8735-4d93-8e11-bdab9e10e39b service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:31.352653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1237/2498] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:15:31.636560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a0569-a176-4490-878a-73ebd530ea23 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:31.638167 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-039a0569-a176-4490-878a-73ebd530ea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:31.651746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a0569-a176-4490-878a-73ebd530ea23 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:31.656500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:31.657142 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:31.657437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:31.657966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] PATH_INFO: `/v3/projects/e55c24d1f025403794da5f7fc093a3da` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:31.659180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e55c24d1f025403794da5f7fc093a3da)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:31.661135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:31.716261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e55c24d1f025403794da5f7fc093a3da', 'request_id': 'req-480476bb-1f95-4513-9163-0f0eae7e788b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.723737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e55c24d1f025403794da5f7fc093a3da', 'request_id': 'req-480476bb-1f95-4513-9163-0f0eae7e788b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.729839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e55c24d1f025403794da5f7fc093a3da', 'request_id': 'req-480476bb-1f95-4513-9163-0f0eae7e788b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.742112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] The token cache is being invalidate because project e55c24d1f025403794da5f7fc093a3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:31.742395 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.743067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.744586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1262/2499] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:31 2022] DELETE /identity/v3/projects/e55c24d1f025403794da5f7fc093a3da => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:31.748762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f14a6a-8735-4d93-8e11-bdab9e10e39b service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:31.759016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f14a6a-8735-4d93-8e11-bdab9e10e39b service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:31.819653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:31.820290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:31.820568 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:31.820841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] PATH_INFO: `/v3/users/107496d907ca4796a824ee36297a2cbe` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:31.822041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=107496d907ca4796a824ee36297a2cbe)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:31.823968 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:31.881363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107496d907ca4796a824ee36297a2cbe'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.882021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107496d907ca4796a824ee36297a2cbe'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.891608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107496d907ca4796a824ee36297a2cbe'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.906646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107496d907ca4796a824ee36297a2cbe'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.907336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e0dcbcb9-0e77-4ff0-8ed5-40bc4da546cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107496d907ca4796a824ee36297a2cbe'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:31.919668 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1238/2500] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:31 2022] DELETE /identity/v3/users/107496d907ca4796a824ee36297a2cbe => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:32.210908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:32.212491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:32.226346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480476bb-1f95-4513-9163-0f0eae7e788b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:32.283376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:32.283962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.284227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.284506 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] PATH_INFO: `/v3/projects/b738eaf9c4334d05928d96fdeabe76db` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.286220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b738eaf9c4334d05928d96fdeabe76db)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:32.288195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:32.305187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:32.337770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b738eaf9c4334d05928d96fdeabe76db', 'request_id': 'req-91e6af32-bbb3-4d7b-82e6-466a274dece8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:32.344957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b738eaf9c4334d05928d96fdeabe76db', 'request_id': 'req-91e6af32-bbb3-4d7b-82e6-466a274dece8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:32.351072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b738eaf9c4334d05928d96fdeabe76db', 'request_id': 'req-91e6af32-bbb3-4d7b-82e6-466a274dece8'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:32.361769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] The token cache is being invalidate because project b738eaf9c4334d05928d96fdeabe76db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:32.362060 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:32.362742 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-91e6af32-bbb3-4d7b-82e6-466a274dece8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:32.364819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1263/2501] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:32 2022] DELETE /identity/v3/projects/b738eaf9c4334d05928d96fdeabe76db => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:32.369650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48c4c-8902-458f-8c0d-fed4f95b3847 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.370120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48c4c-8902-458f-8c0d-fed4f95b3847 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.370222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48c4c-8902-458f-8c0d-fed4f95b3847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.389730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cba48c4c-8902-458f-8c0d-fed4f95b3847 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:32.390974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cba48c4c-8902-458f-8c0d-fed4f95b3847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:32.409990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:32.469200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1239/2502] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:32.479151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd8d90-df96-4140-9342-a0df1f632539 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.479437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd8d90-df96-4140-9342-a0df1f632539 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.479750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd8d90-df96-4140-9342-a0df1f632539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.500012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-bbdd8d90-df96-4140-9342-a0df1f632539 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:32.501203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-bbdd8d90-df96-4140-9342-a0df1f632539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:32.509170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1264/2503] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:32.513557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48c4c-8902-458f-8c0d-fed4f95b3847 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:32.523818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48c4c-8902-458f-8c0d-fed4f95b3847 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:32.528382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175423f4-5f65-4ffb-b560-5a25355932b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:32.528990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175423f4-5f65-4ffb-b560-5a25355932b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.529269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175423f4-5f65-4ffb-b560-5a25355932b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.529542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175423f4-5f65-4ffb-b560-5a25355932b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.530258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175423f4-5f65-4ffb-b560-5a25355932b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:15:32.530595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175423f4-5f65-4ffb-b560-5a25355932b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:32.532211 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175423f4-5f65-4ffb-b560-5a25355932b8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:32.544271 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1240/2504] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:15:32.548525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd8d90-df96-4140-9342-a0df1f632539 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:32.557640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd8d90-df96-4140-9342-a0df1f632539 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:32.562201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ffc9-973e-4d9d-999e-0325d8fe94a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:32.562832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ffc9-973e-4d9d-999e-0325d8fe94a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.563379 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ffc9-973e-4d9d-999e-0325d8fe94a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.563646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ffc9-973e-4d9d-999e-0325d8fe94a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.564299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64ffc9-973e-4d9d-999e-0325d8fe94a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:32.566217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64ffc9-973e-4d9d-999e-0325d8fe94a4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:32.593290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1265/2505] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:32 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:32.597337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175423f4-5f65-4ffb-b560-5a25355932b8 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:32.608283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175423f4-5f65-4ffb-b560-5a25355932b8 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:32.664054 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20ea5e-cbd3-4ff8-96a7-c2f1bb796eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:32.664673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20ea5e-cbd3-4ff8-96a7-c2f1bb796eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.664948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20ea5e-cbd3-4ff8-96a7-c2f1bb796eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.665217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20ea5e-cbd3-4ff8-96a7-c2f1bb796eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.665881 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20ea5e-cbd3-4ff8-96a7-c2f1bb796eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:32.667911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20ea5e-cbd3-4ff8-96a7-c2f1bb796eb2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:32.687941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1241/2506] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:32 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:32.692315 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ffc9-973e-4d9d-999e-0325d8fe94a4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:32.702408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ffc9-973e-4d9d-999e-0325d8fe94a4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:32.707119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4262-b4ef-497e-b802-ddbd374fd301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:32.708222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4262-b4ef-497e-b802-ddbd374fd301 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.708501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4262-b4ef-497e-b802-ddbd374fd301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.708767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4262-b4ef-497e-b802-ddbd374fd301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.709494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd4262-b4ef-497e-b802-ddbd374fd301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:32.711135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd4262-b4ef-497e-b802-ddbd374fd301 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:32.720886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1266/2507] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:32.725659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20ea5e-cbd3-4ff8-96a7-c2f1bb796eb2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:32.735541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20ea5e-cbd3-4ff8-96a7-c2f1bb796eb2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:32.740230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041d830-4152-4ef7-87ca-71fac1889015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:32.740834 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041d830-4152-4ef7-87ca-71fac1889015 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.741116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041d830-4152-4ef7-87ca-71fac1889015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.741389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041d830-4152-4ef7-87ca-71fac1889015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.742083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041d830-4152-4ef7-87ca-71fac1889015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:32.743745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041d830-4152-4ef7-87ca-71fac1889015 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:32.754317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1242/2508] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:32.758355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4262-b4ef-497e-b802-ddbd374fd301 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:32.768735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4262-b4ef-497e-b802-ddbd374fd301 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:32.773850 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd6fc8-e00c-47cd-b8f6-b5587664375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:32.774532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd6fc8-e00c-47cd-b8f6-b5587664375e admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.774818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd6fc8-e00c-47cd-b8f6-b5587664375e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.775097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd6fc8-e00c-47cd-b8f6-b5587664375e admin admin] PATH_INFO: `/v3/projects/de39ea61832e4da78c2354e80feadd50/users/b09a52af5e04447497c11f52d974157d/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.791165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd6fc8-e00c-47cd-b8f6-b5587664375e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de39ea61832e4da78c2354e80feadd50, user_id=b09a52af5e04447497c11f52d974157d, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:32.793825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd6fc8-e00c-47cd-b8f6-b5587664375e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:32.806479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1267/2509] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:32 2022] PUT /identity/v3/projects/de39ea61832e4da78c2354e80feadd50/users/b09a52af5e04447497c11f52d974157d/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:32.817738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7270e-22c4-4fce-ad7f-d2e320275221 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.818025 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7270e-22c4-4fce-ad7f-d2e320275221 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.818302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7270e-22c4-4fce-ad7f-d2e320275221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.846899 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c5a7270e-22c4-4fce-ad7f-d2e320275221 None None] MFA Rules not processed for user `b09a52af5e04447497c11f52d974157d`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:32.848743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c5a7270e-22c4-4fce-ad7f-d2e320275221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:32.912184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1243/2510] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:32.916631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd6fc8-e00c-47cd-b8f6-b5587664375e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:32.977857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd6fc8-e00c-47cd-b8f6-b5587664375e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:32.983011 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deda72e-7828-4b2a-a2b5-7f3e5185ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:32.983616 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deda72e-7828-4b2a-a2b5-7f3e5185ca6b admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:32.983891 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deda72e-7828-4b2a-a2b5-7f3e5185ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:32.984162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deda72e-7828-4b2a-a2b5-7f3e5185ca6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:32.984811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deda72e-7828-4b2a-a2b5-7f3e5185ca6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:32.986757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deda72e-7828-4b2a-a2b5-7f3e5185ca6b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:33.013303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1268/2511] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:32 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:33.017394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7270e-22c4-4fce-ad7f-d2e320275221 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:33.028686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7270e-22c4-4fce-ad7f-d2e320275221 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:33.044496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:33.086577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797dd1c-7a61-4b6a-a90b-a84df2706c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:33.087147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797dd1c-7a61-4b6a-a90b-a84df2706c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:33.087407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797dd1c-7a61-4b6a-a90b-a84df2706c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:33.087680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797dd1c-7a61-4b6a-a90b-a84df2706c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:33.088335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797dd1c-7a61-4b6a-a90b-a84df2706c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:33.090265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797dd1c-7a61-4b6a-a90b-a84df2706c6e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:33.110638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1244/2512] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:33 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:33.114717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deda72e-7828-4b2a-a2b5-7f3e5185ca6b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:33.124836 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deda72e-7828-4b2a-a2b5-7f3e5185ca6b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:33.129844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612a86-7e4c-47d7-ab5b-38774cda16fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:33.130456 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612a86-7e4c-47d7-ab5b-38774cda16fe admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:33.130750 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612a86-7e4c-47d7-ab5b-38774cda16fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:33.131020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612a86-7e4c-47d7-ab5b-38774cda16fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:33.131712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612a86-7e4c-47d7-ab5b-38774cda16fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:33.133302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612a86-7e4c-47d7-ab5b-38774cda16fe admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:33.143460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1269/2513] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:33.147993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797dd1c-7a61-4b6a-a90b-a84df2706c6e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:33.157937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797dd1c-7a61-4b6a-a90b-a84df2706c6e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:33.162539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf1919-12f6-43db-9663-20ca3fd5b699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:33.163185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf1919-12f6-43db-9663-20ca3fd5b699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:33.163467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf1919-12f6-43db-9663-20ca3fd5b699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:33.163742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf1919-12f6-43db-9663-20ca3fd5b699 admin admin] PATH_INFO: `/v3/projects/a8e8423b305749b5a35fa1ac465b07c4/users/abfea8a534ac40d7b2fc3bca578a1229/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:33.178284 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf1919-12f6-43db-9663-20ca3fd5b699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e8423b305749b5a35fa1ac465b07c4, user_id=abfea8a534ac40d7b2fc3bca578a1229, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:33.181149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf1919-12f6-43db-9663-20ca3fd5b699 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:33.195154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1245/2514] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:33 2022] PUT /identity/v3/projects/a8e8423b305749b5a35fa1ac465b07c4/users/abfea8a534ac40d7b2fc3bca578a1229/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:15:33.199297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612a86-7e4c-47d7-ab5b-38774cda16fe admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:33.209764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612a86-7e4c-47d7-ab5b-38774cda16fe admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:33.218664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:33.268908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac33a5f-21a8-4d69-8518-54dc98e3b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:33.269518 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac33a5f-21a8-4d69-8518-54dc98e3b851 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:33.269793 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac33a5f-21a8-4d69-8518-54dc98e3b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:33.270636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac33a5f-21a8-4d69-8518-54dc98e3b851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:33.271329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac33a5f-21a8-4d69-8518-54dc98e3b851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:33.272922 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac33a5f-21a8-4d69-8518-54dc98e3b851 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:33.282688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1270/2515] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:33.286805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf1919-12f6-43db-9663-20ca3fd5b699 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:33.296959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf1919-12f6-43db-9663-20ca3fd5b699 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:33.302024 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3d690-5c80-4cf0-bffe-4e28a4bc7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:33.302698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3d690-5c80-4cf0-bffe-4e28a4bc7686 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:33.302972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3d690-5c80-4cf0-bffe-4e28a4bc7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:33.303237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3d690-5c80-4cf0-bffe-4e28a4bc7686 admin admin] PATH_INFO: `/v3/projects/a8e8423b305749b5a35fa1ac465b07c4/users/abfea8a534ac40d7b2fc3bca578a1229/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:33.305168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3d690-5c80-4cf0-bffe-4e28a4bc7686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e8423b305749b5a35fa1ac465b07c4, user_id=abfea8a534ac40d7b2fc3bca578a1229, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:33.307888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3d690-5c80-4cf0-bffe-4e28a4bc7686 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:33.318685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1246/2516] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:33 2022] PUT /identity/v3/projects/a8e8423b305749b5a35fa1ac465b07c4/users/abfea8a534ac40d7b2fc3bca578a1229/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:33.328716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32afa7-2e80-42b9-8ae4-2f2c810f16c5 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:33.329008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32afa7-2e80-42b9-8ae4-2f2c810f16c5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:33.329288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32afa7-2e80-42b9-8ae4-2f2c810f16c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:33.357221 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-ee32afa7-2e80-42b9-8ae4-2f2c810f16c5 None None] MFA Rules not processed for user `abfea8a534ac40d7b2fc3bca578a1229`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:33.358334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ee32afa7-2e80-42b9-8ae4-2f2c810f16c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:33.425406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1271/2517] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:33.436436 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3d690-5c80-4cf0-bffe-4e28a4bc7686 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:33.438392 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c5f3d690-5c80-4cf0-bffe-4e28a4bc7686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:33.495172 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3d690-5c80-4cf0-bffe-4e28a4bc7686 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:33.498842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c026760-6b0b-4d75-bfe4-0d839f0deedd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:33.499451 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026760-6b0b-4d75-bfe4-0d839f0deedd service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:33.499729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026760-6b0b-4d75-bfe4-0d839f0deedd service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:33.500000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026760-6b0b-4d75-bfe4-0d839f0deedd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:33.510079 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c026760-6b0b-4d75-bfe4-0d839f0deedd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:33.511736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c026760-6b0b-4d75-bfe4-0d839f0deedd service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:33.521420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1247/2518] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:33.654977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32afa7-2e80-42b9-8ae4-2f2c810f16c5 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:33.715441 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32afa7-2e80-42b9-8ae4-2f2c810f16c5 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:33.719944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:33.720574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:33.720854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:33.721126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] PATH_INFO: `/v3/users/b09a52af5e04447497c11f52d974157d` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:33.722284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b09a52af5e04447497c11f52d974157d)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:33.724760 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:33.766013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:33.775303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b09a52af5e04447497c11f52d974157d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:33.776004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b09a52af5e04447497c11f52d974157d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:33.783807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b09a52af5e04447497c11f52d974157d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:33.796317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b09a52af5e04447497c11f52d974157d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:33.796949 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b09a52af5e04447497c11f52d974157d'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:33.809502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1272/2519] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:33 2022] DELETE /identity/v3/users/b09a52af5e04447497c11f52d974157d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:33.814347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29428915-6ac4-492d-9fed-ae45911020d3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:33.814665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29428915-6ac4-492d-9fed-ae45911020d3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:33.814940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29428915-6ac4-492d-9fed-ae45911020d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:33.833409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-29428915-6ac4-492d-9fed-ae45911020d3 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:33.835646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-29428915-6ac4-492d-9fed-ae45911020d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:33.896085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1248/2520] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:33.908147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:33.909686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:33.992605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcb976-8d7a-426b-9291-0702179bf4a3 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:33.997522 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d76bd-6f85-4e69-925e-3bc232b18216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:33.998379 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d76bd-6f85-4e69-925e-3bc232b18216 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:33.998821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d76bd-6f85-4e69-925e-3bc232b18216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:33.999210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d76bd-6f85-4e69-925e-3bc232b18216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:34.011639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d76bd-6f85-4e69-925e-3bc232b18216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:34.013786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d76bd-6f85-4e69-925e-3bc232b18216 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:34.027070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1273/2521] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:34.295893 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29428915-6ac4-492d-9fed-ae45911020d3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:34.298144 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-29428915-6ac4-492d-9fed-ae45911020d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:34.314138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29428915-6ac4-492d-9fed-ae45911020d3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:34.318902 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:34.319539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:34.319809 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:34.320085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] PATH_INFO: `/v3/projects/de39ea61832e4da78c2354e80feadd50` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:34.321279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de39ea61832e4da78c2354e80feadd50)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:34.323208 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:34.334898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:34.371596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de39ea61832e4da78c2354e80feadd50', 'request_id': 'req-2c66696b-7e74-4689-a1de-966789fcb632'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.377098 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de39ea61832e4da78c2354e80feadd50', 'request_id': 'req-2c66696b-7e74-4689-a1de-966789fcb632'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.384275 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de39ea61832e4da78c2354e80feadd50', 'request_id': 'req-2c66696b-7e74-4689-a1de-966789fcb632'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.396713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] The token cache is being invalidate because project de39ea61832e4da78c2354e80feadd50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:34.396996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.397636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.399162 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1249/2522] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:34 2022] DELETE /identity/v3/projects/de39ea61832e4da78c2354e80feadd50 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:34.403105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d76bd-6f85-4e69-925e-3bc232b18216 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:34.412607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d76bd-6f85-4e69-925e-3bc232b18216 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:34.468459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:34.469014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:34.469295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:34.469569 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] PATH_INFO: `/v3/users/abfea8a534ac40d7b2fc3bca578a1229` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:34.470759 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abfea8a534ac40d7b2fc3bca578a1229)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:34.472707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:34.517065 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abfea8a534ac40d7b2fc3bca578a1229'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.517704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abfea8a534ac40d7b2fc3bca578a1229'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.525306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abfea8a534ac40d7b2fc3bca578a1229'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.529698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:34.538970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abfea8a534ac40d7b2fc3bca578a1229'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.540079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e0d4604c-3a2b-4026-9b42-d83518b1b291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abfea8a534ac40d7b2fc3bca578a1229'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.552031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1274/2523] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:34 2022] DELETE /identity/v3/users/abfea8a534ac40d7b2fc3bca578a1229 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:34.824654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:34.826159 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:34.839185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66696b-7e74-4689-a1de-966789fcb632 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:34.897470 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:34.898097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:34.898375 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:34.898675 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] PATH_INFO: `/v3/projects/a8e8423b305749b5a35fa1ac465b07c4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:34.899835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e8423b305749b5a35fa1ac465b07c4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:34.901744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:34.947911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e8423b305749b5a35fa1ac465b07c4', 'request_id': 'req-bc3dde50-49bf-401f-bb88-596b463b949b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.953390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e8423b305749b5a35fa1ac465b07c4', 'request_id': 'req-bc3dde50-49bf-401f-bb88-596b463b949b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.959536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e8423b305749b5a35fa1ac465b07c4', 'request_id': 'req-bc3dde50-49bf-401f-bb88-596b463b949b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.972769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] The token cache is being invalidate because project a8e8423b305749b5a35fa1ac465b07c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:34.973058 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.973681 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bc3dde50-49bf-401f-bb88-596b463b949b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:34.975264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1250/2524] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:34 2022] DELETE /identity/v3/projects/a8e8423b305749b5a35fa1ac465b07c4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:34.980584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343a8b4-a30b-4de5-af1a-281cce6fa1c9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:34.980874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343a8b4-a30b-4de5-af1a-281cce6fa1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:34.981174 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343a8b4-a30b-4de5-af1a-281cce6fa1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.001334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-8343a8b4-a30b-4de5-af1a-281cce6fa1c9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:35.002494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8343a8b4-a30b-4de5-af1a-281cce6fa1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:35.062013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1275/2525] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:35.072055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f62206-5561-4ab2-957f-833967d0582c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.072341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f62206-5561-4ab2-957f-833967d0582c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.072614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f62206-5561-4ab2-957f-833967d0582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.092120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f7f62206-5561-4ab2-957f-833967d0582c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:35.093325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f7f62206-5561-4ab2-957f-833967d0582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:35.101290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1251/2526] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:35.105643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343a8b4-a30b-4de5-af1a-281cce6fa1c9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:35.116016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343a8b4-a30b-4de5-af1a-281cce6fa1c9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:35.120633 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6c134-9d22-422f-b0ee-681dd3f39368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:35.121242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6c134-9d22-422f-b0ee-681dd3f39368 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.121523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6c134-9d22-422f-b0ee-681dd3f39368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.121797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6c134-9d22-422f-b0ee-681dd3f39368 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.122534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6c134-9d22-422f-b0ee-681dd3f39368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:15:35.122840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6c134-9d22-422f-b0ee-681dd3f39368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:35.124463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6c134-9d22-422f-b0ee-681dd3f39368 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:35.137109 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1276/2527] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:15:35.141506 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f62206-5561-4ab2-957f-833967d0582c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:35.150778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f62206-5561-4ab2-957f-833967d0582c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:35.155460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25115c-14bd-4128-865a-94de23755f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:35.156067 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25115c-14bd-4128-865a-94de23755f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.156342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25115c-14bd-4128-865a-94de23755f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.156611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25115c-14bd-4128-865a-94de23755f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.157288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25115c-14bd-4128-865a-94de23755f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:35.159236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25115c-14bd-4128-865a-94de23755f89 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:35.182869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:35.193381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1252/2528] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:35 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:35.194376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6c134-9d22-422f-b0ee-681dd3f39368 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:35.204442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6c134-9d22-422f-b0ee-681dd3f39368 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:35.259807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813907b-b9f5-43c6-a6c5-8b78b62bbb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:35.260331 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813907b-b9f5-43c6-a6c5-8b78b62bbb80 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.260611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813907b-b9f5-43c6-a6c5-8b78b62bbb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.260883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813907b-b9f5-43c6-a6c5-8b78b62bbb80 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.261552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813907b-b9f5-43c6-a6c5-8b78b62bbb80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:35.263514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813907b-b9f5-43c6-a6c5-8b78b62bbb80 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:35.287588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1277/2529] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:35 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:15:35.288896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25115c-14bd-4128-865a-94de23755f89 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:35.299218 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25115c-14bd-4128-865a-94de23755f89 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:35.304660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8180b-7db2-4ff6-ae85-77c68e8eaf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:35.305292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8180b-7db2-4ff6-ae85-77c68e8eaf3c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.305568 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8180b-7db2-4ff6-ae85-77c68e8eaf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.305837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8180b-7db2-4ff6-ae85-77c68e8eaf3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.306608 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8180b-7db2-4ff6-ae85-77c68e8eaf3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:35.308185 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8180b-7db2-4ff6-ae85-77c68e8eaf3c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:35.318512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1253/2530] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:35.380778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813907b-b9f5-43c6-a6c5-8b78b62bbb80 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:35.391223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813907b-b9f5-43c6-a6c5-8b78b62bbb80 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:35.395832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0aec2-cab4-4431-b912-3b49c425c018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:35.396435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0aec2-cab4-4431-b912-3b49c425c018 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.397055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0aec2-cab4-4431-b912-3b49c425c018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.397335 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0aec2-cab4-4431-b912-3b49c425c018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.398064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0aec2-cab4-4431-b912-3b49c425c018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:35.399717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0aec2-cab4-4431-b912-3b49c425c018 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:35.410305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1278/2531] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:35.415008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8180b-7db2-4ff6-ae85-77c68e8eaf3c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:35.425180 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8180b-7db2-4ff6-ae85-77c68e8eaf3c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:35.430390 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37740164-14a2-480c-accc-effc17b50c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:35.431077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740164-14a2-480c-accc-effc17b50c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.431358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740164-14a2-480c-accc-effc17b50c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.431663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740164-14a2-480c-accc-effc17b50c81 admin admin] PATH_INFO: `/v3/projects/07c4ab7018924b4db31b012e308673f7/users/edbac91b636646f68b24e7d371c355ab/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.446783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37740164-14a2-480c-accc-effc17b50c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c4ab7018924b4db31b012e308673f7, user_id=edbac91b636646f68b24e7d371c355ab, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:35.449516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37740164-14a2-480c-accc-effc17b50c81 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:35.463357 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1254/2532] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:35 2022] PUT /identity/v3/projects/07c4ab7018924b4db31b012e308673f7/users/edbac91b636646f68b24e7d371c355ab/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:35.473773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c807-4ffc-44dd-b201-81af9b4ffca9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.474057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c807-4ffc-44dd-b201-81af9b4ffca9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.474330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c807-4ffc-44dd-b201-81af9b4ffca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.502649 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-7fb6c807-4ffc-44dd-b201-81af9b4ffca9 None None] MFA Rules not processed for user `edbac91b636646f68b24e7d371c355ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:35.503887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7fb6c807-4ffc-44dd-b201-81af9b4ffca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:35.533683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:35.568433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1279/2533] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:35.580223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37740164-14a2-480c-accc-effc17b50c81 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:35.582147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-37740164-14a2-480c-accc-effc17b50c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:35.637290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37740164-14a2-480c-accc-effc17b50c81 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:35.641210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750a45f-de7c-4b30-a4bf-661e032247ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:35.641922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750a45f-de7c-4b30-a4bf-661e032247ea service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.642201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750a45f-de7c-4b30-a4bf-661e032247ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.642497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750a45f-de7c-4b30-a4bf-661e032247ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.651871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750a45f-de7c-4b30-a4bf-661e032247ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:35.653301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750a45f-de7c-4b30-a4bf-661e032247ea service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:35.662827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1255/2534] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:35.681855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c807-4ffc-44dd-b201-81af9b4ffca9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:35.746409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c807-4ffc-44dd-b201-81af9b4ffca9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:35.751162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:35.751801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.752082 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.752356 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] PATH_INFO: `/v3/users/edbac91b636646f68b24e7d371c355ab` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.753550 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbac91b636646f68b24e7d371c355ab)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:35.755551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:35.802682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbac91b636646f68b24e7d371c355ab'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:35.803353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbac91b636646f68b24e7d371c355ab'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:35.810644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbac91b636646f68b24e7d371c355ab'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:35.822668 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbac91b636646f68b24e7d371c355ab'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:35.823338 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbac91b636646f68b24e7d371c355ab'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:35.836060 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1280/2535] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:35 2022] DELETE /identity/v3/users/edbac91b636646f68b24e7d371c355ab => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:35.840485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b385477-f3fa-457f-97c4-9df719c06219 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:35.840937 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b385477-f3fa-457f-97c4-9df719c06219 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:35.841052 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b385477-f3fa-457f-97c4-9df719c06219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:35.860079 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3b385477-f3fa-457f-97c4-9df719c06219 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:35.861277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3b385477-f3fa-457f-97c4-9df719c06219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:35.928282 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1256/2536] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:35.938308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:35.939841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:35.999707 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da34cd-1aeb-4c9a-982d-b7148899324b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:36.003367 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeec7b-3332-4fef-b36d-5f24103c3d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:36.003979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeec7b-3332-4fef-b36d-5f24103c3d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.004760 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeec7b-3332-4fef-b36d-5f24103c3d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.005031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeec7b-3332-4fef-b36d-5f24103c3d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.010873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:36.015581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeec7b-3332-4fef-b36d-5f24103c3d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:36.017458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeec7b-3332-4fef-b36d-5f24103c3d9f service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:36.029023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1281/2537] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:36.302025 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b385477-f3fa-457f-97c4-9df719c06219 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:36.303464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3b385477-f3fa-457f-97c4-9df719c06219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:36.318002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b385477-f3fa-457f-97c4-9df719c06219 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:36.323325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:36.324149 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.324434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.324785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] PATH_INFO: `/v3/projects/07c4ab7018924b4db31b012e308673f7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.326071 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c4ab7018924b4db31b012e308673f7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:36.327970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:36.373882 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c4ab7018924b4db31b012e308673f7', 'request_id': 'req-dc96402e-84d7-4131-9597-a7ee21ebc0cc'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:36.379844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c4ab7018924b4db31b012e308673f7', 'request_id': 'req-dc96402e-84d7-4131-9597-a7ee21ebc0cc'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:36.386934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c4ab7018924b4db31b012e308673f7', 'request_id': 'req-dc96402e-84d7-4131-9597-a7ee21ebc0cc'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:36.388680 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:36.400982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] The token cache is being invalidate because project 07c4ab7018924b4db31b012e308673f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:36.401472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:36.402260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-dc96402e-84d7-4131-9597-a7ee21ebc0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:36.403857 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1257/2538] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:36 2022] DELETE /identity/v3/projects/07c4ab7018924b4db31b012e308673f7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:36.408920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4c9cc-2146-4553-8f48-826672fa64b0 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.409279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4c9cc-2146-4553-8f48-826672fa64b0 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.409670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4c9cc-2146-4553-8f48-826672fa64b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.430013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-cef4c9cc-2146-4553-8f48-826672fa64b0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:36.431262 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-cef4c9cc-2146-4553-8f48-826672fa64b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:36.490861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1282/2539] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:36.498457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6efaf-5558-4838-a9da-27145c2f7591 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.498748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6efaf-5558-4838-a9da-27145c2f7591 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.499022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6efaf-5558-4838-a9da-27145c2f7591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.519007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-aad6efaf-5558-4838-a9da-27145c2f7591 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:36.520355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aad6efaf-5558-4838-a9da-27145c2f7591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:36.528240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1258/2540] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:36.532313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4c9cc-2146-4553-8f48-826672fa64b0 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:36.541964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4c9cc-2146-4553-8f48-826672fa64b0 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:36.546513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab244-b12a-4c25-8985-89ce63d2dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:36.547112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab244-b12a-4c25-8985-89ce63d2dbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.547388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab244-b12a-4c25-8985-89ce63d2dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.547660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab244-b12a-4c25-8985-89ce63d2dbf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.548361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ab244-b12a-4c25-8985-89ce63d2dbf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:15:36.548666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ab244-b12a-4c25-8985-89ce63d2dbf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:36.550262 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ab244-b12a-4c25-8985-89ce63d2dbf3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:36.562053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1283/2541] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:15:36.567527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6efaf-5558-4838-a9da-27145c2f7591 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:36.576877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6efaf-5558-4838-a9da-27145c2f7591 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:36.581602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dae91-e535-4467-8698-619f4ffefcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:36.582250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dae91-e535-4467-8698-619f4ffefcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.582584 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dae91-e535-4467-8698-619f4ffefcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.582855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dae91-e535-4467-8698-619f4ffefcb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.583548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dae91-e535-4467-8698-619f4ffefcb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:36.585423 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dae91-e535-4467-8698-619f4ffefcb9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:36.611621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1259/2542] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:36 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:15:36.616370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab244-b12a-4c25-8985-89ce63d2dbf3 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:36.626628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab244-b12a-4c25-8985-89ce63d2dbf3 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:36.686190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38c069-c883-494a-881f-5bdc8e0d4446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:36.686838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c069-c883-494a-881f-5bdc8e0d4446 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.687118 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c069-c883-494a-881f-5bdc8e0d4446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.687385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c069-c883-494a-881f-5bdc8e0d4446 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.688379 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38c069-c883-494a-881f-5bdc8e0d4446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:36.690305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38c069-c883-494a-881f-5bdc8e0d4446 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:36.710784 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1284/2543] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:36 2022] POST /identity/v3/users => generated 281 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:36.714933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dae91-e535-4467-8698-619f4ffefcb9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:36.725770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dae91-e535-4467-8698-619f4ffefcb9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:36.730353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96591e-466f-4a4b-89ea-b36f6a31bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:36.730986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96591e-466f-4a4b-89ea-b36f6a31bceb admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.731263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96591e-466f-4a4b-89ea-b36f6a31bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.731534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96591e-466f-4a4b-89ea-b36f6a31bceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.732230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96591e-466f-4a4b-89ea-b36f6a31bceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:36.733823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96591e-466f-4a4b-89ea-b36f6a31bceb admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:36.744238 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1260/2544] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:36.748158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38c069-c883-494a-881f-5bdc8e0d4446 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:36.758268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38c069-c883-494a-881f-5bdc8e0d4446 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:36.762858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acf9ff-5e3c-41cb-be55-d0270ac5deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:36.763455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acf9ff-5e3c-41cb-be55-d0270ac5deeb admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.763734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acf9ff-5e3c-41cb-be55-d0270ac5deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.764008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acf9ff-5e3c-41cb-be55-d0270ac5deeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.764709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acf9ff-5e3c-41cb-be55-d0270ac5deeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:36.766308 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acf9ff-5e3c-41cb-be55-d0270ac5deeb admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:36.776653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1285/2545] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:36.780469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96591e-466f-4a4b-89ea-b36f6a31bceb admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:36.790827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96591e-466f-4a4b-89ea-b36f6a31bceb admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:36.795379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8889e26-257f-4f6f-8959-e0f066e3872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:36.796016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8889e26-257f-4f6f-8959-e0f066e3872f admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.796293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8889e26-257f-4f6f-8959-e0f066e3872f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.796569 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8889e26-257f-4f6f-8959-e0f066e3872f admin admin] PATH_INFO: `/v3/projects/0b7c115368f747aca13e422f6cc67d78/users/02963452ba0549ceaa49ddcf709c21c5/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.811174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8889e26-257f-4f6f-8959-e0f066e3872f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7c115368f747aca13e422f6cc67d78, user_id=02963452ba0549ceaa49ddcf709c21c5, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:36.814062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8889e26-257f-4f6f-8959-e0f066e3872f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:36.826853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1261/2546] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:36 2022] PUT /identity/v3/projects/0b7c115368f747aca13e422f6cc67d78/users/02963452ba0549ceaa49ddcf709c21c5/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:36.838686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a02ca8-1510-4221-9c9a-079e6b15950d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:36.838972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a02ca8-1510-4221-9c9a-079e6b15950d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:36.839247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a02ca8-1510-4221-9c9a-079e6b15950d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:36.869286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-25a02ca8-1510-4221-9c9a-079e6b15950d None None] MFA Rules not processed for user `02963452ba0549ceaa49ddcf709c21c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:36.870561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-25a02ca8-1510-4221-9c9a-079e6b15950d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:36.918665 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:36.937440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1286/2547] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:15:36.972790 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8889e26-257f-4f6f-8959-e0f066e3872f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:36.974627 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b8889e26-257f-4f6f-8959-e0f066e3872f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:37.033347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8889e26-257f-4f6f-8959-e0f066e3872f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:37.037154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fc4dc-959b-4fbc-bc35-ad62ef7b4d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:37.037856 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fc4dc-959b-4fbc-bc35-ad62ef7b4d89 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:37.038167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fc4dc-959b-4fbc-bc35-ad62ef7b4d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:37.038460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fc4dc-959b-4fbc-bc35-ad62ef7b4d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:37.047314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fc4dc-959b-4fbc-bc35-ad62ef7b4d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:37.048747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fc4dc-959b-4fbc-bc35-ad62ef7b4d89 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:37.058182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1262/2548] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:37.074203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a02ca8-1510-4221-9c9a-079e6b15950d None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:37.138607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a02ca8-1510-4221-9c9a-079e6b15950d None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:37.143404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:37.144225 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:37.144688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:37.145006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] PATH_INFO: `/v3/users/02963452ba0549ceaa49ddcf709c21c5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:37.146404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02963452ba0549ceaa49ddcf709c21c5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:37.148653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:37.201940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02963452ba0549ceaa49ddcf709c21c5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:37.202757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02963452ba0549ceaa49ddcf709c21c5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:37.215831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02963452ba0549ceaa49ddcf709c21c5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:37.231083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02963452ba0549ceaa49ddcf709c21c5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:37.231935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02963452ba0549ceaa49ddcf709c21c5'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:37.247415 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1287/2549] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:37 2022] DELETE /identity/v3/users/02963452ba0549ceaa49ddcf709c21c5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:37.251661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f53ab-da89-47e7-a6f5-3e5bd90b8d81 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:37.251947 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f53ab-da89-47e7-a6f5-3e5bd90b8d81 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:37.252222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f53ab-da89-47e7-a6f5-3e5bd90b8d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:37.272044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b17f53ab-da89-47e7-a6f5-3e5bd90b8d81 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:37.273246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b17f53ab-da89-47e7-a6f5-3e5bd90b8d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:37.335184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1263/2550] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:37.345006 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:37.346475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:37.407962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059302-c0cf-40e9-9214-a7590e836c8d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:37.412063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6549fa5-07f5-44f9-82a9-28aeffa0a885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:37.412684 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6549fa5-07f5-44f9-82a9-28aeffa0a885 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:37.412963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6549fa5-07f5-44f9-82a9-28aeffa0a885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:37.413236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6549fa5-07f5-44f9-82a9-28aeffa0a885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:37.422784 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6549fa5-07f5-44f9-82a9-28aeffa0a885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:37.424227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6549fa5-07f5-44f9-82a9-28aeffa0a885 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:37.437343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1288/2551] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:37.708187 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f53ab-da89-47e7-a6f5-3e5bd90b8d81 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:37.709847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b17f53ab-da89-47e7-a6f5-3e5bd90b8d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:37.722853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f53ab-da89-47e7-a6f5-3e5bd90b8d81 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:37.727904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:37.728538 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:37.728811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:37.729109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] PATH_INFO: `/v3/projects/0b7c115368f747aca13e422f6cc67d78` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:37.730254 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7c115368f747aca13e422f6cc67d78)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:37.732248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:37.765424 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:INSERT=3,keystone:DELETE=2,keystone:SELECT=95 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:37.786705 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7c115368f747aca13e422f6cc67d78', 'request_id': 'req-d0738004-685b-4a3d-bea4-46661d2a7126'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:37.792219 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7c115368f747aca13e422f6cc67d78', 'request_id': 'req-d0738004-685b-4a3d-bea4-46661d2a7126'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:37.798331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7c115368f747aca13e422f6cc67d78', 'request_id': 'req-d0738004-685b-4a3d-bea4-46661d2a7126'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:37.810583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] The token cache is being invalidate because project 0b7c115368f747aca13e422f6cc67d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:37.810888 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:37.811510 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0738004-685b-4a3d-bea4-46661d2a7126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:37.813274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1264/2552] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:37 2022] DELETE /identity/v3/projects/0b7c115368f747aca13e422f6cc67d78 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:37.818119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69f62-6177-4cbf-968a-9214ea460aea None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:37.818533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69f62-6177-4cbf-968a-9214ea460aea None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:37.818755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69f62-6177-4cbf-968a-9214ea460aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:37.838484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d5e69f62-6177-4cbf-968a-9214ea460aea None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:37.839692 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d5e69f62-6177-4cbf-968a-9214ea460aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:37.844960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:37.901079 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1289/2553] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:37.908783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649796a-40c4-41b5-b003-bd4133faad5c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:37.909065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649796a-40c4-41b5-b003-bd4133faad5c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:37.909338 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649796a-40c4-41b5-b003-bd4133faad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:37.933765 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9649796a-40c4-41b5-b003-bd4133faad5c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:37.934938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9649796a-40c4-41b5-b003-bd4133faad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:37.943237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1265/2554] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:37.947528 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e69f62-6177-4cbf-968a-9214ea460aea None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:37.957971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e69f62-6177-4cbf-968a-9214ea460aea None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:37.962721 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c5920-bb1a-43aa-9626-61d54dcb005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:37.963463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5920-bb1a-43aa-9626-61d54dcb005e admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:37.963804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5920-bb1a-43aa-9626-61d54dcb005e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:37.964093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5920-bb1a-43aa-9626-61d54dcb005e admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:37.964856 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c5920-bb1a-43aa-9626-61d54dcb005e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:15:37.965161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c5920-bb1a-43aa-9626-61d54dcb005e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:37.966924 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c5920-bb1a-43aa-9626-61d54dcb005e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:37.979551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1290/2555] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:15:37.984264 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649796a-40c4-41b5-b003-bd4133faad5c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:37.993686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649796a-40c4-41b5-b003-bd4133faad5c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:37.998467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1877-bcad-4180-a4a3-568a63663922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:37.999089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1877-bcad-4180-a4a3-568a63663922 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:37.999367 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1877-bcad-4180-a4a3-568a63663922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:37.999637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1877-bcad-4180-a4a3-568a63663922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:38.000293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a1877-bcad-4180-a4a3-568a63663922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:38.002195 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a1877-bcad-4180-a4a3-568a63663922 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:38.028811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1266/2556] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:37 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:38.033060 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c5920-bb1a-43aa-9626-61d54dcb005e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:38.044569 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c5920-bb1a-43aa-9626-61d54dcb005e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:38.106244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51accc9d-10f8-400f-b06b-f53a81de3068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:38.106960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51accc9d-10f8-400f-b06b-f53a81de3068 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:38.107240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51accc9d-10f8-400f-b06b-f53a81de3068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:38.107513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51accc9d-10f8-400f-b06b-f53a81de3068 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:38.108212 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51accc9d-10f8-400f-b06b-f53a81de3068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:38.110132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51accc9d-10f8-400f-b06b-f53a81de3068 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:38.130988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1291/2557] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:38 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:38.135090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1877-bcad-4180-a4a3-568a63663922 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:38.145694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1877-bcad-4180-a4a3-568a63663922 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:38.150407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f1704-7c64-41af-9834-a78eabd4e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:38.151055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f1704-7c64-41af-9834-a78eabd4e648 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:38.151328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f1704-7c64-41af-9834-a78eabd4e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:38.151590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f1704-7c64-41af-9834-a78eabd4e648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:38.152277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f1704-7c64-41af-9834-a78eabd4e648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:38.153875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f1704-7c64-41af-9834-a78eabd4e648 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:38.163841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1267/2558] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:38.167530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51accc9d-10f8-400f-b06b-f53a81de3068 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:38.177114 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51accc9d-10f8-400f-b06b-f53a81de3068 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:38.182020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68d36a-a907-4354-aa7e-15fc477bdfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:38.182647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68d36a-a907-4354-aa7e-15fc477bdfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:38.182925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68d36a-a907-4354-aa7e-15fc477bdfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:38.183193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68d36a-a907-4354-aa7e-15fc477bdfe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:38.183938 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68d36a-a907-4354-aa7e-15fc477bdfe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:38.185590 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68d36a-a907-4354-aa7e-15fc477bdfe6 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:38.197100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1292/2559] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:38.201077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f1704-7c64-41af-9834-a78eabd4e648 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:38.211995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f1704-7c64-41af-9834-a78eabd4e648 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:38.216630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838021ad-35ba-420b-b18c-1018625bf793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:38.217290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838021ad-35ba-420b-b18c-1018625bf793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:38.217573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838021ad-35ba-420b-b18c-1018625bf793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:38.217869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838021ad-35ba-420b-b18c-1018625bf793 admin admin] PATH_INFO: `/v3/projects/b9b6d2f3d9d145578f56b565d0e19f20/users/5f9edbe65bd14678bff18d0f6f28dcd7/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:38.233057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838021ad-35ba-420b-b18c-1018625bf793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b6d2f3d9d145578f56b565d0e19f20, user_id=5f9edbe65bd14678bff18d0f6f28dcd7, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:38.235772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838021ad-35ba-420b-b18c-1018625bf793 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:38.249204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1268/2560] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:38 2022] PUT /identity/v3/projects/b9b6d2f3d9d145578f56b565d0e19f20/users/5f9edbe65bd14678bff18d0f6f28dcd7/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:38.260340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125c04-0177-4468-8b7b-d59b8ab5e2f2 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:38.260618 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125c04-0177-4468-8b7b-d59b8ab5e2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:38.260886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125c04-0177-4468-8b7b-d59b8ab5e2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:38.289833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-31125c04-0177-4468-8b7b-d59b8ab5e2f2 None None] MFA Rules not processed for user `5f9edbe65bd14678bff18d0f6f28dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:38.291128 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-31125c04-0177-4468-8b7b-d59b8ab5e2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:38.362043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1293/2561] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:15:38.372646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838021ad-35ba-420b-b18c-1018625bf793 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:38.374472 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-838021ad-35ba-420b-b18c-1018625bf793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:38.433044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838021ad-35ba-420b-b18c-1018625bf793 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:38.441199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8612a9-1082-4a06-b2b5-1c727d18cae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:38.442292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8612a9-1082-4a06-b2b5-1c727d18cae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:38.442605 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8612a9-1082-4a06-b2b5-1c727d18cae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:38.442878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8612a9-1082-4a06-b2b5-1c727d18cae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:38.453302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8612a9-1082-4a06-b2b5-1c727d18cae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:38.455428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8612a9-1082-4a06-b2b5-1c727d18cae8 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:38.466302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1269/2562] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:41.471783 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31125c04-0177-4468-8b7b-d59b8ab5e2f2 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:41.480563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:41.535123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31125c04-0177-4468-8b7b-d59b8ab5e2f2 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:41.539632 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:41.540258 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:41.540534 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:41.540810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] PATH_INFO: `/v3/users/5f9edbe65bd14678bff18d0f6f28dcd7` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:41.541960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f9edbe65bd14678bff18d0f6f28dcd7)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:41.543925 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:41.591401 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f9edbe65bd14678bff18d0f6f28dcd7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:41.592139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f9edbe65bd14678bff18d0f6f28dcd7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:41.600234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f9edbe65bd14678bff18d0f6f28dcd7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:41.612347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f9edbe65bd14678bff18d0f6f28dcd7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:41.612988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f9edbe65bd14678bff18d0f6f28dcd7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:41.625524 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1294/2563] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:15:41 2022] DELETE /identity/v3/users/5f9edbe65bd14678bff18d0f6f28dcd7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:41.630573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8d61-e5dd-4b83-a7c7-3307c681749e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:41.631031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8d61-e5dd-4b83-a7c7-3307c681749e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:41.631145 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8d61-e5dd-4b83-a7c7-3307c681749e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:41.650179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-448b8d61-e5dd-4b83-a7c7-3307c681749e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:41.651427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-448b8d61-e5dd-4b83-a7c7-3307c681749e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:41.702477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:41.719270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1270/2564] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:41.729301 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:41.730526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:41.788641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236efcf-a031-4502-bd32-27a5119beb30 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:41.792455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3c25-3d06-4217-8219-83151a63b369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:41.793058 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3c25-3d06-4217-8219-83151a63b369 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:41.793336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3c25-3d06-4217-8219-83151a63b369 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:41.793605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3c25-3d06-4217-8219-83151a63b369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:41.803090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d3c25-3d06-4217-8219-83151a63b369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:41.804514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d3c25-3d06-4217-8219-83151a63b369 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:41.814048 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1295/2565] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:42.089797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b8d61-e5dd-4b83-a7c7-3307c681749e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:42.091379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-448b8d61-e5dd-4b83-a7c7-3307c681749e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:42.104868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b8d61-e5dd-4b83-a7c7-3307c681749e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:42.109652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:42.110288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.111153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.111431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] PATH_INFO: `/v3/projects/b9b6d2f3d9d145578f56b565d0e19f20` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.112799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b6d2f3d9d145578f56b565d0e19f20)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:42.115400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:42.161168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b6d2f3d9d145578f56b565d0e19f20', 'request_id': 'req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:42.166941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b6d2f3d9d145578f56b565d0e19f20', 'request_id': 'req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:42.173190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b6d2f3d9d145578f56b565d0e19f20', 'request_id': 'req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:42.186336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] The token cache is being invalidate because project b9b6d2f3d9d145578f56b565d0e19f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:15:42.186656 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:42.187313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7e4470e3-86d7-4f4b-b7e1-a1a5a83af253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:15:42.189233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1271/2566] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:15:42 2022] DELETE /identity/v3/projects/b9b6d2f3d9d145578f56b565d0e19f20 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:42.194195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753b4f7-9462-4d96-9a17-d43b19a3d0fc None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.194529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753b4f7-9462-4d96-9a17-d43b19a3d0fc None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.194805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753b4f7-9462-4d96-9a17-d43b19a3d0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.214501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a753b4f7-9462-4d96-9a17-d43b19a3d0fc None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:42.215700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a753b4f7-9462-4d96-9a17-d43b19a3d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:42.240624 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:42.276199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1296/2567] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:42.285039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c5cb-8316-4960-8078-839c4442a6a6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.285953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c5cb-8316-4960-8078-839c4442a6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.286230 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c5cb-8316-4960-8078-839c4442a6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.305700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f5b7c5cb-8316-4960-8078-839c4442a6a6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:42.306949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f5b7c5cb-8316-4960-8078-839c4442a6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:42.315285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1272/2568] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:42.319525 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753b4f7-9462-4d96-9a17-d43b19a3d0fc None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:42.329285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753b4f7-9462-4d96-9a17-d43b19a3d0fc None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:42.334663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de5fcf-457d-4f68-8501-2ace478f4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:42.335282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5fcf-457d-4f68-8501-2ace478f4c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.335559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5fcf-457d-4f68-8501-2ace478f4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.335830 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5fcf-457d-4f68-8501-2ace478f4c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.336533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de5fcf-457d-4f68-8501-2ace478f4c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:15:42.336839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de5fcf-457d-4f68-8501-2ace478f4c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:42.338472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de5fcf-457d-4f68-8501-2ace478f4c90 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:42.350620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1297/2569] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 02:15:42.354866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7c5cb-8316-4960-8078-839c4442a6a6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:42.363969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7c5cb-8316-4960-8078-839c4442a6a6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:42.368602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b1547-226a-4e04-b2b1-70636941d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:42.369201 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b1547-226a-4e04-b2b1-70636941d632 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.369480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b1547-226a-4e04-b2b1-70636941d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.369753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b1547-226a-4e04-b2b1-70636941d632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.370407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b1547-226a-4e04-b2b1-70636941d632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:42.372352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b1547-226a-4e04-b2b1-70636941d632 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:42.399468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1273/2570] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:42 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:15:42.403406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de5fcf-457d-4f68-8501-2ace478f4c90 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:42.413934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de5fcf-457d-4f68-8501-2ace478f4c90 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:42.468426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4545-271a-4ddf-8a56-9835234e14ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:42.468967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4545-271a-4ddf-8a56-9835234e14ec admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.469244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4545-271a-4ddf-8a56-9835234e14ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.469511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4545-271a-4ddf-8a56-9835234e14ec admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.470180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa4545-271a-4ddf-8a56-9835234e14ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:42.472146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa4545-271a-4ddf-8a56-9835234e14ec admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:42.493860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1298/2571] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:42 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:42.497814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b1547-226a-4e04-b2b1-70636941d632 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:42.508124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b1547-226a-4e04-b2b1-70636941d632 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:42.512654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79b232-d870-42d6-9083-b3a1c86bde4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:42.513249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79b232-d870-42d6-9083-b3a1c86bde4a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.513530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79b232-d870-42d6-9083-b3a1c86bde4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.513801 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79b232-d870-42d6-9083-b3a1c86bde4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.514522 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79b232-d870-42d6-9083-b3a1c86bde4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:42.516109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79b232-d870-42d6-9083-b3a1c86bde4a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:42.526430 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1274/2572] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:15:42.530243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4545-271a-4ddf-8a56-9835234e14ec admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:42.541224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4545-271a-4ddf-8a56-9835234e14ec admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:42.546157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9b6f-01f2-496d-bcb1-d7151fbd9563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:42.546794 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9b6f-01f2-496d-bcb1-d7151fbd9563 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.547081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9b6f-01f2-496d-bcb1-d7151fbd9563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.547354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9b6f-01f2-496d-bcb1-d7151fbd9563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.548054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf9b6f-01f2-496d-bcb1-d7151fbd9563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:42.549645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf9b6f-01f2-496d-bcb1-d7151fbd9563 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:42.559989 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1299/2573] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:42.564302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79b232-d870-42d6-9083-b3a1c86bde4a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:42.573930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79b232-d870-42d6-9083-b3a1c86bde4a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:42.578735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05802317-4f79-4c39-aabc-40affd5f159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:42.579389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802317-4f79-4c39-aabc-40affd5f159d admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.579672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802317-4f79-4c39-aabc-40affd5f159d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.579946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802317-4f79-4c39-aabc-40affd5f159d admin admin] PATH_INFO: `/v3/projects/21307cc53580410e924842528e5fb5a5/users/b412d6b9d787499a81c96b35375f0a40/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.594859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05802317-4f79-4c39-aabc-40affd5f159d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21307cc53580410e924842528e5fb5a5, user_id=b412d6b9d787499a81c96b35375f0a40, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:42.597493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05802317-4f79-4c39-aabc-40affd5f159d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:42.610326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1275/2574] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:42 2022] PUT /identity/v3/projects/21307cc53580410e924842528e5fb5a5/users/b412d6b9d787499a81c96b35375f0a40/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:42.615244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ac30c-4393-4fb3-89ab-34f184df14f6 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.615556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ac30c-4393-4fb3-89ab-34f184df14f6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.615835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ac30c-4393-4fb3-89ab-34f184df14f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.635141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-2a4ac30c-4393-4fb3-89ab-34f184df14f6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:42.636371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2a4ac30c-4393-4fb3-89ab-34f184df14f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:42.694203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1300/2575] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:42.704239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05802317-4f79-4c39-aabc-40affd5f159d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:42.706162 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-05802317-4f79-4c39-aabc-40affd5f159d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:42.763331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05802317-4f79-4c39-aabc-40affd5f159d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:42.767362 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6e1c6-1e66-4673-9e7c-ff1915a0959c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:42.768014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6e1c6-1e66-4673-9e7c-ff1915a0959c service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:42.768294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6e1c6-1e66-4673-9e7c-ff1915a0959c service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:42.768570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6e1c6-1e66-4673-9e7c-ff1915a0959c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:42.778827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6e1c6-1e66-4673-9e7c-ff1915a0959c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:42.780249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6e1c6-1e66-4673-9e7c-ff1915a0959c service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:42.789997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1276/2576] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:47.131863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770f069-2b6b-41ec-9e38-ce5262a9d798 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:47.132387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770f069-2b6b-41ec-9e38-ce5262a9d798 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:47.132387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770f069-2b6b-41ec-9e38-ce5262a9d798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:47.166423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4770f069-2b6b-41ec-9e38-ce5262a9d798 None None] MFA Rules not processed for user `b412d6b9d787499a81c96b35375f0a40`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:47.167325 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4770f069-2b6b-41ec-9e38-ce5262a9d798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:47.194706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:47.238202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1301/2577] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:47.243295 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6e1c6-1e66-4673-9e7c-ff1915a0959c service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:47.253498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6e1c6-1e66-4673-9e7c-ff1915a0959c service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:47.259504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04439801-7666-460b-aa9d-372bd8c1eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:47.260418 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04439801-7666-460b-aa9d-372bd8c1eea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:47.260704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04439801-7666-460b-aa9d-372bd8c1eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:47.260974 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04439801-7666-460b-aa9d-372bd8c1eea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:47.261841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04439801-7666-460b-aa9d-372bd8c1eea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:47.263841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04439801-7666-460b-aa9d-372bd8c1eea3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:47.280872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:47.297781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1277/2578] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:15:47 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:47.301928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770f069-2b6b-41ec-9e38-ce5262a9d798 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:47.314384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770f069-2b6b-41ec-9e38-ce5262a9d798 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:47.398839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ba265-46c4-4499-b8ab-92f1dddf6e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:47.399497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ba265-46c4-4499-b8ab-92f1dddf6e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:47.399765 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ba265-46c4-4499-b8ab-92f1dddf6e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:47.400038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ba265-46c4-4499-b8ab-92f1dddf6e9d admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:47.400733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ba265-46c4-4499-b8ab-92f1dddf6e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:47.402909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ba265-46c4-4499-b8ab-92f1dddf6e9d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:47.434277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1302/2579] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:15:47 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:15:47.437853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04439801-7666-460b-aa9d-372bd8c1eea3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:47.449302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04439801-7666-460b-aa9d-372bd8c1eea3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:47.454618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17495b-e20b-4064-8211-a1667bcbd45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:47.455514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17495b-e20b-4064-8211-a1667bcbd45e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:47.455993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17495b-e20b-4064-8211-a1667bcbd45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:47.456463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17495b-e20b-4064-8211-a1667bcbd45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:47.457961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17495b-e20b-4064-8211-a1667bcbd45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:47.459837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17495b-e20b-4064-8211-a1667bcbd45e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:47.474616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1278/2580] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:15:47.477446 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ba265-46c4-4499-b8ab-92f1dddf6e9d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:47.488129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ba265-46c4-4499-b8ab-92f1dddf6e9d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:47.493093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ea08-a1d9-48aa-9a2e-c9a63ff35245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:47.493806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ea08-a1d9-48aa-9a2e-c9a63ff35245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:47.494175 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ea08-a1d9-48aa-9a2e-c9a63ff35245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:47.494669 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ea08-a1d9-48aa-9a2e-c9a63ff35245 admin admin] PATH_INFO: `/v3/projects/78114fc677df4e58a07664f5f94c8519/users/7c3b370a1dca4af1a7015d0d9c2bfb45/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:47.517067 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5ea08-a1d9-48aa-9a2e-c9a63ff35245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78114fc677df4e58a07664f5f94c8519, user_id=7c3b370a1dca4af1a7015d0d9c2bfb45, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:47.521378 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5ea08-a1d9-48aa-9a2e-c9a63ff35245 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:47.542982 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1303/2581] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:47 2022] PUT /identity/v3/projects/78114fc677df4e58a07664f5f94c8519/users/7c3b370a1dca4af1a7015d0d9c2bfb45/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:47.543939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17495b-e20b-4064-8211-a1667bcbd45e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:47.557825 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17495b-e20b-4064-8211-a1667bcbd45e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:47.655602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee968799-7869-42e4-a0e8-57659140571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:47.656236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee968799-7869-42e4-a0e8-57659140571e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:47.656513 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee968799-7869-42e4-a0e8-57659140571e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:47.656784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee968799-7869-42e4-a0e8-57659140571e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:47.657483 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee968799-7869-42e4-a0e8-57659140571e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:47.659153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee968799-7869-42e4-a0e8-57659140571e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:47.669919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1279/2582] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:15:47.674108 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ea08-a1d9-48aa-9a2e-c9a63ff35245 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:47.685536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ea08-a1d9-48aa-9a2e-c9a63ff35245 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:47.690532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e344bcf-39af-4b12-8693-df412bc45cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:47.691216 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e344bcf-39af-4b12-8693-df412bc45cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:47.692090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e344bcf-39af-4b12-8693-df412bc45cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:47.692484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e344bcf-39af-4b12-8693-df412bc45cf6 admin admin] PATH_INFO: `/v3/projects/78114fc677df4e58a07664f5f94c8519/users/7c3b370a1dca4af1a7015d0d9c2bfb45/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:47.694507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e344bcf-39af-4b12-8693-df412bc45cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78114fc677df4e58a07664f5f94c8519, user_id=7c3b370a1dca4af1a7015d0d9c2bfb45, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:47.697189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e344bcf-39af-4b12-8693-df412bc45cf6 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:47.710430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1304/2583] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:15:47 2022] PUT /identity/v3/projects/78114fc677df4e58a07664f5f94c8519/users/7c3b370a1dca4af1a7015d0d9c2bfb45/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:15:52.373150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f292-b759-447c-9482-466ab5700039 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:52.373708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f292-b759-447c-9482-466ab5700039 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:52.373708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f292-b759-447c-9482-466ab5700039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:52.403025 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cc75f292-b759-447c-9482-466ab5700039 None None] MFA Rules not processed for user `7c3b370a1dca4af1a7015d0d9c2bfb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:52.404414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cc75f292-b759-447c-9482-466ab5700039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:52.475546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1280/2584] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:15:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:52.487198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e344bcf-39af-4b12-8693-df412bc45cf6 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:52.489497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2e344bcf-39af-4b12-8693-df412bc45cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:52.550132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e344bcf-39af-4b12-8693-df412bc45cf6 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:52.554330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94655b66-ff9b-493f-9064-f8e797a4ca86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece4e0b16a9441b5ba14bbc8ff1c632c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:52.554992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94655b66-ff9b-493f-9064-f8e797a4ca86 service glance] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:52.555270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94655b66-ff9b-493f-9064-f8e797a4ca86 service glance] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:52.555539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94655b66-ff9b-493f-9064-f8e797a4ca86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:52.592107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:52.621593 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94655b66-ff9b-493f-9064-f8e797a4ca86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:52.623097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94655b66-ff9b-493f-9064-f8e797a4ca86 service glance] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:52.632968 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1305/2585] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:15:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:15:52.775313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a268b-2f82-452e-9a37-b7e3045aa2a4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:52.775602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a268b-2f82-452e-9a37-b7e3045aa2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:52.775899 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a268b-2f82-452e-9a37-b7e3045aa2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:52.797039 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-da6a268b-2f82-452e-9a37-b7e3045aa2a4 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:15:52.802534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-da6a268b-2f82-452e-9a37-b7e3045aa2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:52.867202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1281/2586] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:15:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:15:52.924126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94655b66-ff9b-493f-9064-f8e797a4ca86 service glance] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:15:52.925611 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-94655b66-ff9b-493f-9064-f8e797a4ca86 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:15:52.998722 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94655b66-ff9b-493f-9064-f8e797a4ca86 service glance] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:15:53.003892 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753b8ab-a3cd-416c-b885-443811858417 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:15:53.004517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753b8ab-a3cd-416c-b885-443811858417 service swift] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:15:53.004796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753b8ab-a3cd-416c-b885-443811858417 service swift] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:15:53.005202 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753b8ab-a3cd-416c-b885-443811858417 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:15:53.014360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753b8ab-a3cd-416c-b885-443811858417 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:15:53.016027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753b8ab-a3cd-416c-b885-443811858417 service swift] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:15:53.025451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1306/2587] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:15:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:16:02.293153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed51260-5b00-4839-a115-53dd2c727564 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:02.293677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed51260-5b00-4839-a115-53dd2c727564 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:02.293677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed51260-5b00-4839-a115-53dd2c727564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:02.316650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1ed51260-5b00-4839-a115-53dd2c727564 None None] MFA Rules not processed for user `b412d6b9d787499a81c96b35375f0a40`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:16:02.318064 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1ed51260-5b00-4839-a115-53dd2c727564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:16:02.325354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1282/2588] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:16:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:16:02.585290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753b8ab-a3cd-416c-b885-443811858417 service swift] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:16:02.627381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3c41-507a-41e7-89c1-b5094bebb159 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:02.627707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3c41-507a-41e7-89c1-b5094bebb159 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:02.628000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3c41-507a-41e7-89c1-b5094bebb159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:02.636209 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:16:02.648786 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753b8ab-a3cd-416c-b885-443811858417 service swift] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:16:02.649500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1f6e3c41-507a-41e7-89c1-b5094bebb159 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:16:02.650738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1f6e3c41-507a-41e7-89c1-b5094bebb159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:16:02.652407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8faaa-058c-4e8f-8e27-7e75c25f2d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:16:02.653016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8faaa-058c-4e8f-8e27-7e75c25f2d91 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:02.653296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8faaa-058c-4e8f-8e27-7e75c25f2d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:02.653563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8faaa-058c-4e8f-8e27-7e75c25f2d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:02.655423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ddf8faaa-058c-4e8f-8e27-7e75c25f2d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:16:02.657877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1283/2589] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:16:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:16:02.665347 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8faaa-058c-4e8f-8e27-7e75c25f2d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:16:02.666930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8faaa-058c-4e8f-8e27-7e75c25f2d91 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:16:02.670006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e3c41-507a-41e7-89c1-b5094bebb159 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:16:02.675958 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1307/2590] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:16:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:16:02.682748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e3c41-507a-41e7-89c1-b5094bebb159 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:16:02.687841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e60b63-726a-4b39-a685-ac679cdcaffe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:16:02.688735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e60b63-726a-4b39-a685-ac679cdcaffe service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:02.688996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e60b63-726a-4b39-a685-ac679cdcaffe service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:02.689269 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e60b63-726a-4b39-a685-ac679cdcaffe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:02.698318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e60b63-726a-4b39-a685-ac679cdcaffe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:16:02.699958 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e60b63-726a-4b39-a685-ac679cdcaffe service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:16:02.708572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1284/2591] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:16:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 02:16:04.657543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f232c-a89a-4302-b29b-44511de049b9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:04.658092 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f232c-a89a-4302-b29b-44511de049b9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:04.658092 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f232c-a89a-4302-b29b-44511de049b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:04.683081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a83f232c-a89a-4302-b29b-44511de049b9 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:16:04.684445 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a83f232c-a89a-4302-b29b-44511de049b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:16:04.697986 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1308/2592] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:16:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:16:04.710019 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e60b63-726a-4b39-a685-ac679cdcaffe service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:16:04.725372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e60b63-726a-4b39-a685-ac679cdcaffe service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:16:04.732302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16f946-fb5d-41cc-8b06-96f1fbc46522 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:16:04.734292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16f946-fb5d-41cc-8b06-96f1fbc46522 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:04.734818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16f946-fb5d-41cc-8b06-96f1fbc46522 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:04.735328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16f946-fb5d-41cc-8b06-96f1fbc46522 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:04.749181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16f946-fb5d-41cc-8b06-96f1fbc46522 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:16:04.751925 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16f946-fb5d-41cc-8b06-96f1fbc46522 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:16:04.766835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1285/2593] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:16:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:16:14.676531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=74 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:16:14.759288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=14 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:16:26.711716 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d45ad-7bdf-438b-8d76-236dfec9ec0e None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:26.712658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d45ad-7bdf-438b-8d76-236dfec9ec0e None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:26.712934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d45ad-7bdf-438b-8d76-236dfec9ec0e None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:26.714354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1309/2594] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:16:26.722469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e119f-1292-4287-b8aa-aaf1c977bcf8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:26.723002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e119f-1292-4287-b8aa-aaf1c977bcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:26.723190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e119f-1292-4287-b8aa-aaf1c977bcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:26.743487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-236e119f-1292-4287-b8aa-aaf1c977bcf8 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:16:26.744609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-236e119f-1292-4287-b8aa-aaf1c977bcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:16:26.811319 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1286/2595] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:16:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:16:26.823600 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d45ad-7bdf-438b-8d76-236dfec9ec0e None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:16:26.836406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d45ad-7bdf-438b-8d76-236dfec9ec0e None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:16:26.840960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc67a9-8441-4520-9500-e3054eabdd0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece4e0b16a9441b5ba14bbc8ff1c632c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:16:26.841654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc67a9-8441-4520-9500-e3054eabdd0e service glance] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:26.841931 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc67a9-8441-4520-9500-e3054eabdd0e service glance] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:26.842266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc67a9-8441-4520-9500-e3054eabdd0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:26.865140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc67a9-8441-4520-9500-e3054eabdd0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:16:26.866787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc67a9-8441-4520-9500-e3054eabdd0e service glance] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:16:26.880936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1310/2596] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:16:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:16:26.959588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85c82-3e16-4184-a1f7-912794a8eaf6 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:26.959904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85c82-3e16-4184-a1f7-912794a8eaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:26.960184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85c82-3e16-4184-a1f7-912794a8eaf6 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:26.961549 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1287/2597] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:16:26.966369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b827d-4f72-4882-a291-2bfda92b9108 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:26.966695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b827d-4f72-4882-a291-2bfda92b9108 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:26.966974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b827d-4f72-4882-a291-2bfda92b9108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:26.986737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d42b827d-4f72-4882-a291-2bfda92b9108 None None] MFA Rules not processed for user `50bf5763fbf94aa9b438a1be6ce88c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:16:26.988496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d42b827d-4f72-4882-a291-2bfda92b9108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:16:26.995373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1311/2598] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:16:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:16:27.006867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85c82-3e16-4184-a1f7-912794a8eaf6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:16:27.017648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85c82-3e16-4184-a1f7-912794a8eaf6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:16:27.021261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9582bc-a926-4f9d-b5c4-2098723990e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:16:27.021860 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9582bc-a926-4f9d-b5c4-2098723990e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:27.022139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9582bc-a926-4f9d-b5c4-2098723990e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:27.022412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9582bc-a926-4f9d-b5c4-2098723990e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:27.029381 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9582bc-a926-4f9d-b5c4-2098723990e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:16:27.030855 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9582bc-a926-4f9d-b5c4-2098723990e7 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:16:27.038986 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1288/2599] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:16:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:16:27.122660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f790-2128-451a-87cd-3cf313dd1767 None None] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:27.122941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f790-2128-451a-87cd-3cf313dd1767 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:27.123219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f790-2128-451a-87cd-3cf313dd1767 None None] PATH_INFO: `/` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:27.124617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1312/2600] 10.222.0.36 () {54 vars in 921 bytes} [Thu Jul 28 02:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 02:16:27.129560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a610-14e2-4548-924c-7399e3a780d6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:27.129846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a610-14e2-4548-924c-7399e3a780d6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:27.130127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a610-14e2-4548-924c-7399e3a780d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:27.149653 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9497a610-14e2-4548-924c-7399e3a780d6 None None] MFA Rules not processed for user `b9f911e716994f1f9d4705216ee0f3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:16:27.150925 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9497a610-14e2-4548-924c-7399e3a780d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:16:27.160762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1289/2601] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Jul 28 02:16:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:16:27.171189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66f790-2128-451a-87cd-3cf313dd1767 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:16:27.182732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66f790-2128-451a-87cd-3cf313dd1767 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:16:27.186259 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf2db0-18d6-465a-8c9a-8ec4588830fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:16:27.186884 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf2db0-18d6-465a-8c9a-8ec4588830fb service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:27.187158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf2db0-18d6-465a-8c9a-8ec4588830fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:27.187428 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf2db0-18d6-465a-8c9a-8ec4588830fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:27.197823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf2db0-18d6-465a-8c9a-8ec4588830fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:16:27.199281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf2db0-18d6-465a-8c9a-8ec4588830fb service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:16:27.209807 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1313/2602] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:16:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:16:28.902785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a0e20-985a-481e-8df4-186217be2750 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:28.903206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a0e20-985a-481e-8df4-186217be2750 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:28.903341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a0e20-985a-481e-8df4-186217be2750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:28.921748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-287a0e20-985a-481e-8df4-186217be2750 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:16:28.922962 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-287a0e20-985a-481e-8df4-186217be2750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:16:28.930502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1290/2603] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Jul 28 02:16:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:16:28.942805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf2db0-18d6-465a-8c9a-8ec4588830fb service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:16:28.953882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf2db0-18d6-465a-8c9a-8ec4588830fb service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:16:28.959159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546d89f-1b24-4627-90f1-e3e56b15558f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:16:28.959751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546d89f-1b24-4627-90f1-e3e56b15558f service swift] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:28.960025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546d89f-1b24-4627-90f1-e3e56b15558f service swift] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:28.960292 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546d89f-1b24-4627-90f1-e3e56b15558f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:28.968131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546d89f-1b24-4627-90f1-e3e56b15558f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:16:28.969686 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546d89f-1b24-4627-90f1-e3e56b15558f service swift] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:16:28.977575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1314/2604] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:16:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:16:38.916657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=43 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:16:38.974390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=21 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:16:46.510666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a0e20-985a-481e-8df4-186217be2750 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:16:46.532397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a0e20-985a-481e-8df4-186217be2750 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:16:46.536088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef23bc-3366-4e1c-a235-5d0f491f2a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:16:46.536697 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef23bc-3366-4e1c-a235-5d0f491f2a11 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:46.536999 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef23bc-3366-4e1c-a235-5d0f491f2a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:46.537273 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef23bc-3366-4e1c-a235-5d0f491f2a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:46.567666 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef23bc-3366-4e1c-a235-5d0f491f2a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:16:46.569088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef23bc-3366-4e1c-a235-5d0f491f2a11 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:16:46.578352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1291/2605] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:16:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:16:49.654602 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedaa6f-9ffc-4873-82bd-9c33a73dced5 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:49.655073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedaa6f-9ffc-4873-82bd-9c33a73dced5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:49.655196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedaa6f-9ffc-4873-82bd-9c33a73dced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:49.707473 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-2dedaa6f-9ffc-4873-82bd-9c33a73dced5 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:16:49.708923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2dedaa6f-9ffc-4873-82bd-9c33a73dced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:16:49.743502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1315/2606] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jul 28 02:16:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:16:49.771970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef23bc-3366-4e1c-a235-5d0f491f2a11 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:16:49.788253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef23bc-3366-4e1c-a235-5d0f491f2a11 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:16:49.807799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cad9-d408-4731-a482-36c6a2d0ebaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:16:49.808926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cad9-d408-4731-a482-36c6a2d0ebaa service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:49.809764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cad9-d408-4731-a482-36c6a2d0ebaa service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:49.810204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cad9-d408-4731-a482-36c6a2d0ebaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:49.845233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475cad9-d408-4731-a482-36c6a2d0ebaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:16:49.846997 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475cad9-d408-4731-a482-36c6a2d0ebaa service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:16:49.886286 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1292/2607] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:16:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:16:53.427880 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedaa6f-9ffc-4873-82bd-9c33a73dced5 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:16:53.437303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedaa6f-9ffc-4873-82bd-9c33a73dced5 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:16:53.441173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93118e37-507f-4a99-bf07-ee9654f8c7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:16:53.441772 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93118e37-507f-4a99-bf07-ee9654f8c7db service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:16:53.442052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93118e37-507f-4a99-bf07-ee9654f8c7db service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:16:53.442326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93118e37-507f-4a99-bf07-ee9654f8c7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:16:53.444085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-93118e37-507f-4a99-bf07-ee9654f8c7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:16:53.502074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93118e37-507f-4a99-bf07-ee9654f8c7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:16:53.503594 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93118e37-507f-4a99-bf07-ee9654f8c7db service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:16:53.512499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1316/2608] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:16:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:16:59.870336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=26 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:02.641028 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cad9-d408-4731-a482-36c6a2d0ebaa service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:02.674081 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cad9-d408-4731-a482-36c6a2d0ebaa service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:02.677746 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067af30-b18f-40d6-8e46-a8f1e84ee89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:02.678358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067af30-b18f-40d6-8e46-a8f1e84ee89c service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:02.678668 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067af30-b18f-40d6-8e46-a8f1e84ee89c service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:02.678943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067af30-b18f-40d6-8e46-a8f1e84ee89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:02.680683 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3067af30-b18f-40d6-8e46-a8f1e84ee89c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:02.769048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067af30-b18f-40d6-8e46-a8f1e84ee89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:02.770562 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067af30-b18f-40d6-8e46-a8f1e84ee89c service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:02.791099 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1293/2609] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:17:03.508410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=46 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:05.950542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93118e37-507f-4a99-bf07-ee9654f8c7db service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:05.951973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-93118e37-507f-4a99-bf07-ee9654f8c7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:06.050180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93118e37-507f-4a99-bf07-ee9654f8c7db service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:06.055244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682fe65-c3db-4477-8c7a-2835a7d087b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:06.055863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682fe65-c3db-4477-8c7a-2835a7d087b9 service placement] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:06.056147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682fe65-c3db-4477-8c7a-2835a7d087b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:06.056422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682fe65-c3db-4477-8c7a-2835a7d087b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:06.058655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e682fe65-c3db-4477-8c7a-2835a7d087b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:06.071051 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682fe65-c3db-4477-8c7a-2835a7d087b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:06.072659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682fe65-c3db-4477-8c7a-2835a7d087b9 service placement] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:06.083410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1317/2610] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:17:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:17:06.738837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067af30-b18f-40d6-8e46-a8f1e84ee89c service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:06.740237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3067af30-b18f-40d6-8e46-a8f1e84ee89c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:06.764498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067af30-b18f-40d6-8e46-a8f1e84ee89c service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:06.768342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515192d-1e37-4a76-a56f-fb80f1215500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:06.769564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515192d-1e37-4a76-a56f-fb80f1215500 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:06.769837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515192d-1e37-4a76-a56f-fb80f1215500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:06.770105 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515192d-1e37-4a76-a56f-fb80f1215500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:06.771847 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5515192d-1e37-4a76-a56f-fb80f1215500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:06.784148 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515192d-1e37-4a76-a56f-fb80f1215500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:06.785573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515192d-1e37-4a76-a56f-fb80f1215500 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:06.795682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1294/2611] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:17:09.689084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682fe65-c3db-4477-8c7a-2835a7d087b9 service placement] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:09.691213 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e682fe65-c3db-4477-8c7a-2835a7d087b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:09.705467 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682fe65-c3db-4477-8c7a-2835a7d087b9 service placement] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:09.710653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:09.711274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:09.711553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:09.711828 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] PATH_INFO: `/v3/users/b9edeb4401274a77ab9a7391bf02cbd1` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:09.713158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9edeb4401274a77ab9a7391bf02cbd1)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:09.715498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:09.766895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9edeb4401274a77ab9a7391bf02cbd1'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:09.767560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9edeb4401274a77ab9a7391bf02cbd1'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:09.775587 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9edeb4401274a77ab9a7391bf02cbd1'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:09.787744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9edeb4401274a77ab9a7391bf02cbd1'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:09.788411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9edeb4401274a77ab9a7391bf02cbd1'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:09.801497 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1318/2612] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:17:09 2022] DELETE /identity/v3/users/b9edeb4401274a77ab9a7391bf02cbd1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:17:10.035661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515192d-1e37-4a76-a56f-fb80f1215500 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:10.050884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515192d-1e37-4a76-a56f-fb80f1215500 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:10.124926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:10.125601 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:10.125864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:10.126141 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] PATH_INFO: `/v3/projects/9955be925a854d13be4e8a55589e6f4e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:10.127361 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9955be925a854d13be4e8a55589e6f4e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:10.129830 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:10.171862 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:10.184517 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9955be925a854d13be4e8a55589e6f4e', 'request_id': 'req-e501bb5c-6805-463e-93c0-549deb2812ab'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.192204 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9955be925a854d13be4e8a55589e6f4e', 'request_id': 'req-e501bb5c-6805-463e-93c0-549deb2812ab'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.199411 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9955be925a854d13be4e8a55589e6f4e', 'request_id': 'req-e501bb5c-6805-463e-93c0-549deb2812ab'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.212393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] The token cache is being invalidate because project 9955be925a854d13be4e8a55589e6f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:17:10.212682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.213293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.214819 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1295/2613] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:17:10 2022] DELETE /identity/v3/projects/9955be925a854d13be4e8a55589e6f4e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:17:10.219355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:10.221277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:10.234708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a556f-2cd6-4e85-8bf3-ebc413344673 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:10.282553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:10.304336 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:10.304991 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:10.305472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:10.305746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] PATH_INFO: `/v3/users/667f281e9b4748b89e91e41d123e568a` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:10.307078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667f281e9b4748b89e91e41d123e568a)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:10.309217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:10.379948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667f281e9b4748b89e91e41d123e568a'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.381511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667f281e9b4748b89e91e41d123e568a'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.391266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667f281e9b4748b89e91e41d123e568a'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.407021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667f281e9b4748b89e91e41d123e568a'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.408455 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667f281e9b4748b89e91e41d123e568a'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.422338 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1319/2614] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:17:10 2022] DELETE /identity/v3/users/667f281e9b4748b89e91e41d123e568a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:17:10.627919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:10.629536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:10.650106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501bb5c-6805-463e-93c0-549deb2812ab admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:10.722932 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:10.723725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:10.724160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:10.724535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] PATH_INFO: `/v3/projects/4bf41878f0bf47a2b608521f4df9c3a4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:10.725895 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf41878f0bf47a2b608521f4df9c3a4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:10.728487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:10.785380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf41878f0bf47a2b608521f4df9c3a4', 'request_id': 'req-053403c3-6341-4799-807a-d57738ff079b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.793831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf41878f0bf47a2b608521f4df9c3a4', 'request_id': 'req-053403c3-6341-4799-807a-d57738ff079b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.801493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf41878f0bf47a2b608521f4df9c3a4', 'request_id': 'req-053403c3-6341-4799-807a-d57738ff079b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.816473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] The token cache is being invalidate because project 4bf41878f0bf47a2b608521f4df9c3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:17:10.817066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.818119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:10.825615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1296/2615] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:17:10 2022] DELETE /identity/v3/projects/4bf41878f0bf47a2b608521f4df9c3a4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:17:10.977001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:10.978863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:10.997157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9ead3-3849-4c19-9d1c-9ca618927948 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:11.061389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:11.062044 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.062329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.062920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] PATH_INFO: `/v3/users/80ab8a36909341869be8db4c103c4059` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:11.064135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ab8a36909341869be8db4c103c4059)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:11.066131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:11.120559 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ab8a36909341869be8db4c103c4059'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:11.121137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ab8a36909341869be8db4c103c4059'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:11.128396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ab8a36909341869be8db4c103c4059'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:11.135585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:11.141646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ab8a36909341869be8db4c103c4059'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:11.142555 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-bc82bf41-4512-4110-b9c7-86069363b3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ab8a36909341869be8db4c103c4059'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:11.155178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1320/2616] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:17:10 2022] DELETE /identity/v3/users/80ab8a36909341869be8db4c103c4059 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:17:11.326853 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:11.328313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:11.343083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053403c3-6341-4799-807a-d57738ff079b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:11.396337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:11.407394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:11.408090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.408372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.408647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] PATH_INFO: `/v3/projects/7c911b0d2d654cff8df77a5483ad08bf` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:11.409870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c911b0d2d654cff8df77a5483ad08bf)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:11.411850 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:11.459266 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c911b0d2d654cff8df77a5483ad08bf', 'request_id': 'req-752ce9fc-bb5c-48cd-8752-96b189ce159f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:11.465540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c911b0d2d654cff8df77a5483ad08bf', 'request_id': 'req-752ce9fc-bb5c-48cd-8752-96b189ce159f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:11.472063 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c911b0d2d654cff8df77a5483ad08bf', 'request_id': 'req-752ce9fc-bb5c-48cd-8752-96b189ce159f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:11.486117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] The token cache is being invalidate because project 7c911b0d2d654cff8df77a5483ad08bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:17:11.486415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:11.487606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-752ce9fc-bb5c-48cd-8752-96b189ce159f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:17:11.489134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1297/2617] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:17:11 2022] DELETE /identity/v3/projects/7c911b0d2d654cff8df77a5483ad08bf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:17:11.494135 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41252d5-bef7-4233-97e2-46edef48b81a None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.494585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41252d5-bef7-4233-97e2-46edef48b81a None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.494943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41252d5-bef7-4233-97e2-46edef48b81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:11.555083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-c41252d5-bef7-4233-97e2-46edef48b81a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:17:11.556300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c41252d5-bef7-4233-97e2-46edef48b81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:11.614818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1321/2618] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:17:11.622866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbef5b-089f-4b16-821a-8a761dae6216 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.623157 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbef5b-089f-4b16-821a-8a761dae6216 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.623437 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbef5b-089f-4b16-821a-8a761dae6216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:11.643462 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-12bbef5b-089f-4b16-821a-8a761dae6216 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:17:11.644667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-12bbef5b-089f-4b16-821a-8a761dae6216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:11.652717 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1298/2619] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:17:11.656853 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41252d5-bef7-4233-97e2-46edef48b81a None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:11.666411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41252d5-bef7-4233-97e2-46edef48b81a None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:11.671123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13595f21-f85f-4d45-ae3e-0d0471d27b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:11.671720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13595f21-f85f-4d45-ae3e-0d0471d27b6f admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.672001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13595f21-f85f-4d45-ae3e-0d0471d27b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.672274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13595f21-f85f-4d45-ae3e-0d0471d27b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:11.672972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13595f21-f85f-4d45-ae3e-0d0471d27b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:17:11.673275 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13595f21-f85f-4d45-ae3e-0d0471d27b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:11.675488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13595f21-f85f-4d45-ae3e-0d0471d27b6f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:11.686778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1322/2620] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:17:11.691832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbef5b-089f-4b16-821a-8a761dae6216 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:11.701615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbef5b-089f-4b16-821a-8a761dae6216 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:11.706198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c864bb-5806-42a0-8761-b7fcc20d20ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:11.706822 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c864bb-5806-42a0-8761-b7fcc20d20ae admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.707115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c864bb-5806-42a0-8761-b7fcc20d20ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.707386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c864bb-5806-42a0-8761-b7fcc20d20ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:11.708076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c864bb-5806-42a0-8761-b7fcc20d20ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:11.709969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c864bb-5806-42a0-8761-b7fcc20d20ae admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:11.742747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1299/2621] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:17:11 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:17:11.747105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13595f21-f85f-4d45-ae3e-0d0471d27b6f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:11.758247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13595f21-f85f-4d45-ae3e-0d0471d27b6f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:11.813871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878927f0-cf47-4eb2-9b80-abe90e09227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:11.814507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878927f0-cf47-4eb2-9b80-abe90e09227b admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.814785 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878927f0-cf47-4eb2-9b80-abe90e09227b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.815053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878927f0-cf47-4eb2-9b80-abe90e09227b admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:11.816281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878927f0-cf47-4eb2-9b80-abe90e09227b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:11.818181 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878927f0-cf47-4eb2-9b80-abe90e09227b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:11.842103 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1323/2622] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:17:11 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:17:11.846221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c864bb-5806-42a0-8761-b7fcc20d20ae admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:11.857345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c864bb-5806-42a0-8761-b7fcc20d20ae admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:11.862115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4d6e9-cc93-4464-8315-31d902ae9b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:11.863288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4d6e9-cc93-4464-8315-31d902ae9b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.863573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4d6e9-cc93-4464-8315-31d902ae9b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.863845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4d6e9-cc93-4464-8315-31d902ae9b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:11.864540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4d6e9-cc93-4464-8315-31d902ae9b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:11.866171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4d6e9-cc93-4464-8315-31d902ae9b98 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:11.876389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1300/2623] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:17:11.880508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878927f0-cf47-4eb2-9b80-abe90e09227b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:11.890411 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878927f0-cf47-4eb2-9b80-abe90e09227b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:11.894980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb8312-312d-4b8c-b2d6-dca8e3d7e34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:11.895571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8312-312d-4b8c-b2d6-dca8e3d7e34f admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.895847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8312-312d-4b8c-b2d6-dca8e3d7e34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.896113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8312-312d-4b8c-b2d6-dca8e3d7e34f admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:11.896799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb8312-312d-4b8c-b2d6-dca8e3d7e34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:11.898386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb8312-312d-4b8c-b2d6-dca8e3d7e34f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:11.909774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1324/2624] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:17:11.914431 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4d6e9-cc93-4464-8315-31d902ae9b98 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:11.934596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4d6e9-cc93-4464-8315-31d902ae9b98 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:11.939622 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb025b-57e1-437a-9235-c942b9bf9bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:11.940290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb025b-57e1-437a-9235-c942b9bf9bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.940571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb025b-57e1-437a-9235-c942b9bf9bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.940848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb025b-57e1-437a-9235-c942b9bf9bfd admin admin] PATH_INFO: `/v3/projects/8b203a6c14664b26bb9c2ce6bf52e6d6/users/a040f742005145a58f1d9f17d538ed24/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:11.956160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb025b-57e1-437a-9235-c942b9bf9bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b203a6c14664b26bb9c2ce6bf52e6d6, user_id=a040f742005145a58f1d9f17d538ed24, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:11.959078 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb025b-57e1-437a-9235-c942b9bf9bfd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:11.972519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1301/2625] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:17:11 2022] PUT /identity/v3/projects/8b203a6c14664b26bb9c2ce6bf52e6d6/users/a040f742005145a58f1d9f17d538ed24/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:17:11.977762 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924da24-b2b1-429d-8ff2-e245ffe7f047 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:11.978274 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924da24-b2b1-429d-8ff2-e245ffe7f047 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:11.978373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924da24-b2b1-429d-8ff2-e245ffe7f047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:12.001330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4924da24-b2b1-429d-8ff2-e245ffe7f047 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:17:12.002564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4924da24-b2b1-429d-8ff2-e245ffe7f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:12.012142 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:12.063168 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1325/2626] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:17:12.072714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb025b-57e1-437a-9235-c942b9bf9bfd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:12.074396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8cfb025b-57e1-437a-9235-c942b9bf9bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:12.136613 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb025b-57e1-437a-9235-c942b9bf9bfd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:12.140436 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ae0e-a517-4841-b227-dd346dee9cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:12.141053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ae0e-a517-4841-b227-dd346dee9cbf service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:12.141334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ae0e-a517-4841-b227-dd346dee9cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:12.141612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ae0e-a517-4841-b227-dd346dee9cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:12.150595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ae0e-a517-4841-b227-dd346dee9cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:12.152015 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ae0e-a517-4841-b227-dd346dee9cbf service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:12.163544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1302/2627] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:17:16.133904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acd5f3-0271-4ae6-bc6d-f85ba81136e3 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:16.134833 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acd5f3-0271-4ae6-bc6d-f85ba81136e3 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:16.135112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acd5f3-0271-4ae6-bc6d-f85ba81136e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:16.167310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-15acd5f3-0271-4ae6-bc6d-f85ba81136e3 None None] MFA Rules not processed for user `a040f742005145a58f1d9f17d538ed24`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:17:16.168551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-15acd5f3-0271-4ae6-bc6d-f85ba81136e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:16.252021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1326/2628] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:17:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:17:16.260719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ae0e-a517-4841-b227-dd346dee9cbf service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:16.262168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0320ae0e-a517-4841-b227-dd346dee9cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:16.291714 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:16.372362 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ae0e-a517-4841-b227-dd346dee9cbf service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:16.377911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e08a5f-3563-416c-a451-73638fb7f586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:16.378633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08a5f-3563-416c-a451-73638fb7f586 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:16.378919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08a5f-3563-416c-a451-73638fb7f586 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:16.379197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08a5f-3563-416c-a451-73638fb7f586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:16.386960 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e08a5f-3563-416c-a451-73638fb7f586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:16.388560 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e08a5f-3563-416c-a451-73638fb7f586 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:16.397306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1303/2629] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:17:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:17:17.958475 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46da5af-e8c6-435b-92f2-edd8cfe05bc6 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:17.958955 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46da5af-e8c6-435b-92f2-edd8cfe05bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:17.959063 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46da5af-e8c6-435b-92f2-edd8cfe05bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:17.980289 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e46da5af-e8c6-435b-92f2-edd8cfe05bc6 None None] MFA Rules not processed for user `a040f742005145a58f1d9f17d538ed24`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:17:17.981652 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e46da5af-e8c6-435b-92f2-edd8cfe05bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:17.989303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1327/2630] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:17:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:17:26.393401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=33 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:27.973975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=55 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:53.251924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e08a5f-3563-416c-a451-73638fb7f586 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:17:53.253306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-23e08a5f-3563-416c-a451-73638fb7f586 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:53.321858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e08a5f-3563-416c-a451-73638fb7f586 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:17:53.326818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a34a7f-41cc-4404-ae0b-995d390c44a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:17:53.327427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a34a7f-41cc-4404-ae0b-995d390c44a8 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:17:53.327701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a34a7f-41cc-4404-ae0b-995d390c44a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:17:53.327970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a34a7f-41cc-4404-ae0b-995d390c44a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:17:53.329747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-01a34a7f-41cc-4404-ae0b-995d390c44a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:17:53.341616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a34a7f-41cc-4404-ae0b-995d390c44a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:17:53.343302 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a34a7f-41cc-4404-ae0b-995d390c44a8 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:17:53.353621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1304/2631] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:17:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:03.349478 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=32 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:04.107142 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46da5af-e8c6-435b-92f2-edd8cfe05bc6 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:04.117388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46da5af-e8c6-435b-92f2-edd8cfe05bc6 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:04.120972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042500a8-06a0-4532-9dea-7a2bdcf4ee52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:04.121568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042500a8-06a0-4532-9dea-7a2bdcf4ee52 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:04.121892 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042500a8-06a0-4532-9dea-7a2bdcf4ee52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:04.122161 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042500a8-06a0-4532-9dea-7a2bdcf4ee52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:04.123923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-042500a8-06a0-4532-9dea-7a2bdcf4ee52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:04.136008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042500a8-06a0-4532-9dea-7a2bdcf4ee52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:04.137622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042500a8-06a0-4532-9dea-7a2bdcf4ee52 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:04.147171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1328/2632] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:07.263493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a34a7f-41cc-4404-ae0b-995d390c44a8 service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:07.265079 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-01a34a7f-41cc-4404-ae0b-995d390c44a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:07.280140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a34a7f-41cc-4404-ae0b-995d390c44a8 service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:07.284793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:07.285458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:07.286299 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:07.286614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] PATH_INFO: `/v3/users/7451d5de3e664f29b3a53699af7a5c60` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:07.287792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7451d5de3e664f29b3a53699af7a5c60)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:07.289778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:07.342715 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7451d5de3e664f29b3a53699af7a5c60'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:07.343372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7451d5de3e664f29b3a53699af7a5c60'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:07.351094 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7451d5de3e664f29b3a53699af7a5c60'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:07.363244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7451d5de3e664f29b3a53699af7a5c60'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:07.363883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0e5d9808-058f-4bed-9565-9899c4957b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7451d5de3e664f29b3a53699af7a5c60'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:07.375896 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1305/2633] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:07 2022] DELETE /identity/v3/users/7451d5de3e664f29b3a53699af7a5c60 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:07.551424 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042500a8-06a0-4532-9dea-7a2bdcf4ee52 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:07.568896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042500a8-06a0-4532-9dea-7a2bdcf4ee52 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:07.750343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:07.750992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:07.751265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:07.751529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] PATH_INFO: `/v3/projects/ac88e006b77d49379e6abd7b1646a04f` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:07.752664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac88e006b77d49379e6abd7b1646a04f)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:07.755125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:07.798130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac88e006b77d49379e6abd7b1646a04f', 'request_id': 'req-ec580411-dd65-4f90-a520-373c7ae70bbb'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:07.806162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac88e006b77d49379e6abd7b1646a04f', 'request_id': 'req-ec580411-dd65-4f90-a520-373c7ae70bbb'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:07.811593 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac88e006b77d49379e6abd7b1646a04f', 'request_id': 'req-ec580411-dd65-4f90-a520-373c7ae70bbb'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:07.822992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] The token cache is being invalidate because project ac88e006b77d49379e6abd7b1646a04f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:07.823272 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:07.823883 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ec580411-dd65-4f90-a520-373c7ae70bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:07.825363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1329/2634] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:07 2022] DELETE /identity/v3/projects/ac88e006b77d49379e6abd7b1646a04f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:07.830270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd9be7-87b1-4847-b234-8f2f8a9f24ad None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:07.830604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd9be7-87b1-4847-b234-8f2f8a9f24ad None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:07.830912 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd9be7-87b1-4847-b234-8f2f8a9f24ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:07.850080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-94bd9be7-87b1-4847-b234-8f2f8a9f24ad None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:07.851884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-94bd9be7-87b1-4847-b234-8f2f8a9f24ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:07.911093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1306/2635] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:07.918881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00337d-e18c-4144-9005-9299d37f3580 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:07.919166 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00337d-e18c-4144-9005-9299d37f3580 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:07.919434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00337d-e18c-4144-9005-9299d37f3580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:07.938893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-2f00337d-e18c-4144-9005-9299d37f3580 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:07.940072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2f00337d-e18c-4144-9005-9299d37f3580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:07.948442 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1330/2636] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:07.952446 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd9be7-87b1-4847-b234-8f2f8a9f24ad None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:07.962055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd9be7-87b1-4847-b234-8f2f8a9f24ad None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:07.966663 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e39898-f0aa-484f-9b7f-f242d8229804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:07.967261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e39898-f0aa-484f-9b7f-f242d8229804 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:07.967541 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e39898-f0aa-484f-9b7f-f242d8229804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:07.967814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e39898-f0aa-484f-9b7f-f242d8229804 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:07.968509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e39898-f0aa-484f-9b7f-f242d8229804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:18:07.968815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e39898-f0aa-484f-9b7f-f242d8229804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:07.970396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e39898-f0aa-484f-9b7f-f242d8229804 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:07.981734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1307/2637] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:18:07.985788 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00337d-e18c-4144-9005-9299d37f3580 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:07.997604 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00337d-e18c-4144-9005-9299d37f3580 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:08.002242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f4fc-fb87-4b71-8067-5e63b38a343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:08.002882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f4fc-fb87-4b71-8067-5e63b38a343c admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:08.003162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f4fc-fb87-4b71-8067-5e63b38a343c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:08.003429 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f4fc-fb87-4b71-8067-5e63b38a343c admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:08.004074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f4fc-fb87-4b71-8067-5e63b38a343c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:08.006619 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f4fc-fb87-4b71-8067-5e63b38a343c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:08.032228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1331/2638] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:18:07 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:08.036719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e39898-f0aa-484f-9b7f-f242d8229804 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:08.046735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e39898-f0aa-484f-9b7f-f242d8229804 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:08.102918 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fd613-78f2-4248-a6af-8e960338fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:08.103532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fd613-78f2-4248-a6af-8e960338fa5f admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:08.103811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fd613-78f2-4248-a6af-8e960338fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:08.104080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fd613-78f2-4248-a6af-8e960338fa5f admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:08.104741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fd613-78f2-4248-a6af-8e960338fa5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:08.106660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fd613-78f2-4248-a6af-8e960338fa5f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:08.114867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:08.129798 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1308/2639] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:18:08 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:08.134014 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f4fc-fb87-4b71-8067-5e63b38a343c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:08.144337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f4fc-fb87-4b71-8067-5e63b38a343c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:08.148992 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4e289-8a8e-4f8f-a557-7daf82246fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:08.149586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e289-8a8e-4f8f-a557-7daf82246fba admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:08.149861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e289-8a8e-4f8f-a557-7daf82246fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:08.150129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e289-8a8e-4f8f-a557-7daf82246fba admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:08.150857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4e289-8a8e-4f8f-a557-7daf82246fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:08.152435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4e289-8a8e-4f8f-a557-7daf82246fba admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:08.163418 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1332/2640] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:08.166718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fd613-78f2-4248-a6af-8e960338fa5f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:08.177104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fd613-78f2-4248-a6af-8e960338fa5f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:08.181865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bddce-07b9-49ba-abe8-044cd2cfac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:08.182486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bddce-07b9-49ba-abe8-044cd2cfac6f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:08.182773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bddce-07b9-49ba-abe8-044cd2cfac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:08.183045 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bddce-07b9-49ba-abe8-044cd2cfac6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:08.183737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bddce-07b9-49ba-abe8-044cd2cfac6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:08.185307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bddce-07b9-49ba-abe8-044cd2cfac6f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:08.195979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1309/2641] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:08.199811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4e289-8a8e-4f8f-a557-7daf82246fba admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:08.209384 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4e289-8a8e-4f8f-a557-7daf82246fba admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:08.213888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329babe9-5b33-467e-8b6d-ef2187340634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:08.214542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329babe9-5b33-467e-8b6d-ef2187340634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:08.214823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329babe9-5b33-467e-8b6d-ef2187340634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:08.215091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329babe9-5b33-467e-8b6d-ef2187340634 admin admin] PATH_INFO: `/v3/projects/bf85fa6d9153426583abfd0243dd6dbb/users/d83a387011094f2e9180e7a608fc6c0c/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:08.229386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329babe9-5b33-467e-8b6d-ef2187340634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf85fa6d9153426583abfd0243dd6dbb, user_id=d83a387011094f2e9180e7a608fc6c0c, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:08.232078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329babe9-5b33-467e-8b6d-ef2187340634 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:08.245622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1333/2642] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:08 2022] PUT /identity/v3/projects/bf85fa6d9153426583abfd0243dd6dbb/users/d83a387011094f2e9180e7a608fc6c0c/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:08.255632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c261e0a-1017-4b8d-ae91-81052944ac41 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:08.255916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c261e0a-1017-4b8d-ae91-81052944ac41 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:08.256182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c261e0a-1017-4b8d-ae91-81052944ac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:08.282924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5c261e0a-1017-4b8d-ae91-81052944ac41 None None] MFA Rules not processed for user `d83a387011094f2e9180e7a608fc6c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:08.284112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5c261e0a-1017-4b8d-ae91-81052944ac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:08.346990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1310/2643] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:08.358511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329babe9-5b33-467e-8b6d-ef2187340634 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:08.360159 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-329babe9-5b33-467e-8b6d-ef2187340634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:08.374767 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:08.434198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329babe9-5b33-467e-8b6d-ef2187340634 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:08.439871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e38c06-4ace-43e6-a87d-0b04a6a53b6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:08.440471 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e38c06-4ace-43e6-a87d-0b04a6a53b6b service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:08.440746 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e38c06-4ace-43e6-a87d-0b04a6a53b6b service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:08.441015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e38c06-4ace-43e6-a87d-0b04a6a53b6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:08.448538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e38c06-4ace-43e6-a87d-0b04a6a53b6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:08.450073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e38c06-4ace-43e6-a87d-0b04a6a53b6b service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:08.459062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1334/2644] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:08.659637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c261e0a-1017-4b8d-ae91-81052944ac41 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:08.722005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c261e0a-1017-4b8d-ae91-81052944ac41 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:08.726836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:08.727995 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:08.728277 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:08.728556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] PATH_INFO: `/v3/users/d83a387011094f2e9180e7a608fc6c0c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:08.729767 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83a387011094f2e9180e7a608fc6c0c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:08.732368 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:08.780075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83a387011094f2e9180e7a608fc6c0c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:08.780730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83a387011094f2e9180e7a608fc6c0c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:08.788026 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83a387011094f2e9180e7a608fc6c0c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:08.799012 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:08.800388 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83a387011094f2e9180e7a608fc6c0c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:08.801173 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83a387011094f2e9180e7a608fc6c0c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:08.815089 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1311/2645] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:08 2022] DELETE /identity/v3/users/d83a387011094f2e9180e7a608fc6c0c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:08.821241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac24de-13e3-41f7-bdf1-ca49bca859dd None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:08.821705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac24de-13e3-41f7-bdf1-ca49bca859dd None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:08.821802 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac24de-13e3-41f7-bdf1-ca49bca859dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:08.842023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-c2ac24de-13e3-41f7-bdf1-ca49bca859dd None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:08.843255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c2ac24de-13e3-41f7-bdf1-ca49bca859dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:08.902535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1335/2646] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:08.912162 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:08.913566 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:08.971841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046e98-f766-4ff1-b8e0-0c3c65c06e0f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:08.975647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe90b0a-23aa-436a-83ed-eab5b0a40721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:08.976196 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe90b0a-23aa-436a-83ed-eab5b0a40721 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:08.976476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe90b0a-23aa-436a-83ed-eab5b0a40721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:08.976747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe90b0a-23aa-436a-83ed-eab5b0a40721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:08.985599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe90b0a-23aa-436a-83ed-eab5b0a40721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:08.987088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe90b0a-23aa-436a-83ed-eab5b0a40721 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:08.996427 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1312/2647] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:09.275787 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac24de-13e3-41f7-bdf1-ca49bca859dd None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:09.277248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c2ac24de-13e3-41f7-bdf1-ca49bca859dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:09.290897 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac24de-13e3-41f7-bdf1-ca49bca859dd None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:09.295834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:09.296812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:09.297236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:09.297625 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] PATH_INFO: `/v3/projects/bf85fa6d9153426583abfd0243dd6dbb` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:09.299328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf85fa6d9153426583abfd0243dd6dbb)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:09.302976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:09.359498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf85fa6d9153426583abfd0243dd6dbb', 'request_id': 'req-099011cb-6d33-4106-906b-47ff47e6736e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:09.367127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf85fa6d9153426583abfd0243dd6dbb', 'request_id': 'req-099011cb-6d33-4106-906b-47ff47e6736e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:09.372589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf85fa6d9153426583abfd0243dd6dbb', 'request_id': 'req-099011cb-6d33-4106-906b-47ff47e6736e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:09.384030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] The token cache is being invalidate because project bf85fa6d9153426583abfd0243dd6dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:09.384309 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:09.384951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-099011cb-6d33-4106-906b-47ff47e6736e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:09.386406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1336/2648] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:09 2022] DELETE /identity/v3/projects/bf85fa6d9153426583abfd0243dd6dbb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:09.391407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99872cf4-b5a2-403c-b4ac-a4bd9470c5a7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:09.391883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99872cf4-b5a2-403c-b4ac-a4bd9470c5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:09.391990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99872cf4-b5a2-403c-b4ac-a4bd9470c5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:09.411448 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-99872cf4-b5a2-403c-b4ac-a4bd9470c5a7 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:09.412643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-99872cf4-b5a2-403c-b4ac-a4bd9470c5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:09.472311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1313/2649] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:09.481536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b649a-1cf2-4e55-adbf-e1a38f7244c2 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:09.481852 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b649a-1cf2-4e55-adbf-e1a38f7244c2 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:09.482157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b649a-1cf2-4e55-adbf-e1a38f7244c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:09.503021 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-303b649a-1cf2-4e55-adbf-e1a38f7244c2 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:09.504789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-303b649a-1cf2-4e55-adbf-e1a38f7244c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:09.512974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1337/2650] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:09.517210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99872cf4-b5a2-403c-b4ac-a4bd9470c5a7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:09.527101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99872cf4-b5a2-403c-b4ac-a4bd9470c5a7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:09.531642 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd3f6-6fef-47be-bbce-0340a0523ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:09.532252 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd3f6-6fef-47be-bbce-0340a0523ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:09.532530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd3f6-6fef-47be-bbce-0340a0523ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:09.532802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd3f6-6fef-47be-bbce-0340a0523ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:09.533492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd3f6-6fef-47be-bbce-0340a0523ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:18:09.533793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd3f6-6fef-47be-bbce-0340a0523ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:09.535935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd3f6-6fef-47be-bbce-0340a0523ed9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:09.547315 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1314/2651] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:18:09.552334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b649a-1cf2-4e55-adbf-e1a38f7244c2 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:09.562936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b649a-1cf2-4e55-adbf-e1a38f7244c2 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:09.567922 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703fe0d-7d11-49db-813d-b7a929d25de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:09.568571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703fe0d-7d11-49db-813d-b7a929d25de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:09.568854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703fe0d-7d11-49db-813d-b7a929d25de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:09.569889 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703fe0d-7d11-49db-813d-b7a929d25de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:09.570617 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703fe0d-7d11-49db-813d-b7a929d25de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:09.572564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703fe0d-7d11-49db-813d-b7a929d25de1 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:09.588337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:09.601696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1338/2652] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:18:09 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:18:09.605899 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd3f6-6fef-47be-bbce-0340a0523ed9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:09.616598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd3f6-6fef-47be-bbce-0340a0523ed9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:09.672778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4209d-d58c-426e-b519-2cdb243f2b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:09.673397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4209d-d58c-426e-b519-2cdb243f2b09 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:09.673676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4209d-d58c-426e-b519-2cdb243f2b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:09.673953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4209d-d58c-426e-b519-2cdb243f2b09 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:09.674648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4209d-d58c-426e-b519-2cdb243f2b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:09.678083 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4209d-d58c-426e-b519-2cdb243f2b09 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:09.705314 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1315/2653] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:18:09 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:09.709305 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703fe0d-7d11-49db-813d-b7a929d25de1 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:09.719662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703fe0d-7d11-49db-813d-b7a929d25de1 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:09.724803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc972a6-fee4-483a-be89-9f8e32720200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:09.725399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc972a6-fee4-483a-be89-9f8e32720200 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:09.725679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc972a6-fee4-483a-be89-9f8e32720200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:09.725951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc972a6-fee4-483a-be89-9f8e32720200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:09.726690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc972a6-fee4-483a-be89-9f8e32720200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:09.728286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc972a6-fee4-483a-be89-9f8e32720200 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:09.738122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1339/2654] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:09.742945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4209d-d58c-426e-b519-2cdb243f2b09 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:09.753281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4209d-d58c-426e-b519-2cdb243f2b09 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:09.757965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f28b2-df1a-48f6-aac8-efc5598ffc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:09.758616 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f28b2-df1a-48f6-aac8-efc5598ffc62 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:09.758898 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f28b2-df1a-48f6-aac8-efc5598ffc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:09.759171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f28b2-df1a-48f6-aac8-efc5598ffc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:09.759867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f28b2-df1a-48f6-aac8-efc5598ffc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:09.761447 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f28b2-df1a-48f6-aac8-efc5598ffc62 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:09.762699 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:09.776592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1316/2655] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:09.777865 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc972a6-fee4-483a-be89-9f8e32720200 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:09.788298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc972a6-fee4-483a-be89-9f8e32720200 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:09.793042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5343ce-825a-4c7f-93e2-8198ab16b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:09.793699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5343ce-825a-4c7f-93e2-8198ab16b16b admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:09.793977 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5343ce-825a-4c7f-93e2-8198ab16b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:09.794251 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5343ce-825a-4c7f-93e2-8198ab16b16b admin admin] PATH_INFO: `/v3/projects/e17b91130a394075a16522c7220960f5/users/26776e56984749468083a52dc38bdc6c/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:09.810102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5343ce-825a-4c7f-93e2-8198ab16b16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17b91130a394075a16522c7220960f5, user_id=26776e56984749468083a52dc38bdc6c, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:09.813086 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5343ce-825a-4c7f-93e2-8198ab16b16b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:09.834532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1340/2656] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:09 2022] PUT /identity/v3/projects/e17b91130a394075a16522c7220960f5/users/26776e56984749468083a52dc38bdc6c/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:09.849304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c89b1-590f-461e-9c37-505e216cd66e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:09.849618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c89b1-590f-461e-9c37-505e216cd66e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:09.849901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c89b1-590f-461e-9c37-505e216cd66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:09.878582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-142c89b1-590f-461e-9c37-505e216cd66e None None] MFA Rules not processed for user `26776e56984749468083a52dc38bdc6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:09.879782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-142c89b1-590f-461e-9c37-505e216cd66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:09.944515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1317/2657] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:09.949196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5343ce-825a-4c7f-93e2-8198ab16b16b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:10.010690 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5343ce-825a-4c7f-93e2-8198ab16b16b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:10.015341 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2aca0-7dc8-4df4-8cdb-40df80f14123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:10.015944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2aca0-7dc8-4df4-8cdb-40df80f14123 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:10.016227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2aca0-7dc8-4df4-8cdb-40df80f14123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:10.016500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2aca0-7dc8-4df4-8cdb-40df80f14123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:10.017156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2aca0-7dc8-4df4-8cdb-40df80f14123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:10.019096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2aca0-7dc8-4df4-8cdb-40df80f14123 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:10.047831 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1341/2658] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:18:09 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:10.052334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c89b1-590f-461e-9c37-505e216cd66e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:10.063459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c89b1-590f-461e-9c37-505e216cd66e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:10.119952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef26f75-6131-4a67-aff4-63253cf071bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:10.120566 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef26f75-6131-4a67-aff4-63253cf071bf admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:10.120845 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef26f75-6131-4a67-aff4-63253cf071bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:10.121131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef26f75-6131-4a67-aff4-63253cf071bf admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:10.121806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef26f75-6131-4a67-aff4-63253cf071bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:10.123743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef26f75-6131-4a67-aff4-63253cf071bf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:10.145573 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1318/2659] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:18:10 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:10.149606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2aca0-7dc8-4df4-8cdb-40df80f14123 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:10.159729 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2aca0-7dc8-4df4-8cdb-40df80f14123 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:10.164811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9366-e072-4793-9807-86a2d84a7417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:10.165402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9366-e072-4793-9807-86a2d84a7417 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:10.165676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9366-e072-4793-9807-86a2d84a7417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:10.165944 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9366-e072-4793-9807-86a2d84a7417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:10.166667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d9366-e072-4793-9807-86a2d84a7417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:10.168276 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d9366-e072-4793-9807-86a2d84a7417 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:10.178389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1342/2660] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:10.182539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef26f75-6131-4a67-aff4-63253cf071bf admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:10.192859 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef26f75-6131-4a67-aff4-63253cf071bf admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:10.197528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97639e8a-b303-4a9b-a901-cc77369c190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:10.198179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639e8a-b303-4a9b-a901-cc77369c190f admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:10.198486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639e8a-b303-4a9b-a901-cc77369c190f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:10.198768 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97639e8a-b303-4a9b-a901-cc77369c190f admin admin] PATH_INFO: `/v3/projects/aac451cbdf6a482c803652fefe8141cf/users/5118841b0f92451798c67db1fc47b0a9/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:10.213693 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97639e8a-b303-4a9b-a901-cc77369c190f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac451cbdf6a482c803652fefe8141cf, user_id=5118841b0f92451798c67db1fc47b0a9, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:10.216389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97639e8a-b303-4a9b-a901-cc77369c190f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:10.229667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1319/2661] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:10 2022] PUT /identity/v3/projects/aac451cbdf6a482c803652fefe8141cf/users/5118841b0f92451798c67db1fc47b0a9/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:10.233584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9366-e072-4793-9807-86a2d84a7417 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:10.243655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9366-e072-4793-9807-86a2d84a7417 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:10.298623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a8772-07d0-4df2-a5e7-636522c6b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:10.299155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8772-07d0-4df2-a5e7-636522c6b2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:10.299435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8772-07d0-4df2-a5e7-636522c6b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:10.299706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8772-07d0-4df2-a5e7-636522c6b2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:10.300399 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a8772-07d0-4df2-a5e7-636522c6b2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:10.301985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a8772-07d0-4df2-a5e7-636522c6b2bc admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:10.311463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1343/2662] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:10.316413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97639e8a-b303-4a9b-a901-cc77369c190f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:10.327327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97639e8a-b303-4a9b-a901-cc77369c190f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:10.331943 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d6673-3abd-450e-a9e8-f0b93124d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:10.333225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d6673-3abd-450e-a9e8-f0b93124d575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:10.333507 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d6673-3abd-450e-a9e8-f0b93124d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:10.333785 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d6673-3abd-450e-a9e8-f0b93124d575 admin admin] PATH_INFO: `/v3/projects/aac451cbdf6a482c803652fefe8141cf/users/5118841b0f92451798c67db1fc47b0a9/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:10.335786 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d6673-3abd-450e-a9e8-f0b93124d575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac451cbdf6a482c803652fefe8141cf, user_id=5118841b0f92451798c67db1fc47b0a9, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:10.338492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d6673-3abd-450e-a9e8-f0b93124d575 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:10.348583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1320/2663] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:10 2022] PUT /identity/v3/projects/aac451cbdf6a482c803652fefe8141cf/users/5118841b0f92451798c67db1fc47b0a9/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:10.358628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc1032-f0e0-4a55-a3b0-d7c9850215cb None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:10.358921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc1032-f0e0-4a55-a3b0-d7c9850215cb None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:10.359197 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc1032-f0e0-4a55-a3b0-d7c9850215cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:10.386712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-64fc1032-f0e0-4a55-a3b0-d7c9850215cb None None] MFA Rules not processed for user `5118841b0f92451798c67db1fc47b0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:10.387969 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-64fc1032-f0e0-4a55-a3b0-d7c9850215cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:10.404657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:10.458094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1344/2664] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:10 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:10.468604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d6673-3abd-450e-a9e8-f0b93124d575 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:10.470568 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cc7d6673-3abd-450e-a9e8-f0b93124d575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:10.514900 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:10.552161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d6673-3abd-450e-a9e8-f0b93124d575 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:10.555741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a0167-e2bf-49dc-9bed-4071e384c405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:10.556351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a0167-e2bf-49dc-9bed-4071e384c405 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:10.556630 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a0167-e2bf-49dc-9bed-4071e384c405 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:10.556897 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a0167-e2bf-49dc-9bed-4071e384c405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:10.566209 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a0167-e2bf-49dc-9bed-4071e384c405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:10.568158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a0167-e2bf-49dc-9bed-4071e384c405 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:10.577394 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1321/2665] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:10 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:10.730825 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc1032-f0e0-4a55-a3b0-d7c9850215cb None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:10.792496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc1032-f0e0-4a55-a3b0-d7c9850215cb None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:10.797265 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:10.797921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:10.798212 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:10.798519 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] PATH_INFO: `/v3/users/26776e56984749468083a52dc38bdc6c` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:10.799744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26776e56984749468083a52dc38bdc6c)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:10.802249 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:10.849735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26776e56984749468083a52dc38bdc6c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:10.850420 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26776e56984749468083a52dc38bdc6c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:10.857677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26776e56984749468083a52dc38bdc6c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:10.871596 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26776e56984749468083a52dc38bdc6c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:10.872361 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26776e56984749468083a52dc38bdc6c'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:10.884861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1345/2666] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:10 2022] DELETE /identity/v3/users/26776e56984749468083a52dc38bdc6c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:18:10.889270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b326b26-1277-4f40-a27c-8bbbf280cb30 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:10.889556 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b326b26-1277-4f40-a27c-8bbbf280cb30 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:10.889830 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b326b26-1277-4f40-a27c-8bbbf280cb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:10.908459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3b326b26-1277-4f40-a27c-8bbbf280cb30 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:10.909646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3b326b26-1277-4f40-a27c-8bbbf280cb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:10.968621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1322/2667] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:10.978941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:10.980370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:11.015778 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:11.039143 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95a58-f120-4d27-9dda-e3451931df6e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:11.042782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db301695-5bde-4b4f-b992-a641c053d763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:11.043385 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db301695-5bde-4b4f-b992-a641c053d763 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:11.043661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db301695-5bde-4b4f-b992-a641c053d763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:11.043930 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db301695-5bde-4b4f-b992-a641c053d763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:11.053526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db301695-5bde-4b4f-b992-a641c053d763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:11.055023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db301695-5bde-4b4f-b992-a641c053d763 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:11.064642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1346/2668] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:11.342953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b326b26-1277-4f40-a27c-8bbbf280cb30 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:11.344387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3b326b26-1277-4f40-a27c-8bbbf280cb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:11.360169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b326b26-1277-4f40-a27c-8bbbf280cb30 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:11.365832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:11.366508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:11.366793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:11.367070 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] PATH_INFO: `/v3/projects/e17b91130a394075a16522c7220960f5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:11.368248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17b91130a394075a16522c7220960f5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:11.370200 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:11.417376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17b91130a394075a16522c7220960f5', 'request_id': 'req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:11.423066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17b91130a394075a16522c7220960f5', 'request_id': 'req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:11.429945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17b91130a394075a16522c7220960f5', 'request_id': 'req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:11.449103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] The token cache is being invalidate because project e17b91130a394075a16522c7220960f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:11.449400 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:11.450055 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:11.451707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1323/2669] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:11 2022] DELETE /identity/v3/projects/e17b91130a394075a16522c7220960f5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:11.455661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db301695-5bde-4b4f-b992-a641c053d763 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:11.466366 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db301695-5bde-4b4f-b992-a641c053d763 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:11.524141 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:11.524773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:11.525055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:11.525333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] PATH_INFO: `/v3/users/5118841b0f92451798c67db1fc47b0a9` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:11.526535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5118841b0f92451798c67db1fc47b0a9)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:11.528507 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:11.574935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5118841b0f92451798c67db1fc47b0a9'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:11.575657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5118841b0f92451798c67db1fc47b0a9'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:11.583851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5118841b0f92451798c67db1fc47b0a9'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:11.596895 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5118841b0f92451798c67db1fc47b0a9'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:11.597539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-4df0b27d-878b-40a1-8bef-55d6d3e31e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5118841b0f92451798c67db1fc47b0a9'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:11.610784 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1347/2670] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:11 2022] DELETE /identity/v3/users/5118841b0f92451798c67db1fc47b0a9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:11.883281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:11.884764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:11.900323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b8818-208c-45b3-a6b5-7d1e6ca7e45a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:11.943270 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:11.959700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:11.960336 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:11.960609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:11.960880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] PATH_INFO: `/v3/projects/aac451cbdf6a482c803652fefe8141cf` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:11.962029 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac451cbdf6a482c803652fefe8141cf)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:11.963975 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.012234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac451cbdf6a482c803652fefe8141cf', 'request_id': 'req-b57c8687-f94d-4897-8c02-40acc009d317'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:12.018347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac451cbdf6a482c803652fefe8141cf', 'request_id': 'req-b57c8687-f94d-4897-8c02-40acc009d317'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:12.024578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac451cbdf6a482c803652fefe8141cf', 'request_id': 'req-b57c8687-f94d-4897-8c02-40acc009d317'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:12.037202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] The token cache is being invalidate because project aac451cbdf6a482c803652fefe8141cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:12.037497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:12.038116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b57c8687-f94d-4897-8c02-40acc009d317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:12.039652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1324/2671] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:11 2022] DELETE /identity/v3/projects/aac451cbdf6a482c803652fefe8141cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:12.044589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761e3b0-ebb9-4381-9173-2f99b890c132 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.045059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761e3b0-ebb9-4381-9173-2f99b890c132 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.045170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761e3b0-ebb9-4381-9173-2f99b890c132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.067516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f761e3b0-ebb9-4381-9173-2f99b890c132 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:12.068770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f761e3b0-ebb9-4381-9173-2f99b890c132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:12.115950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:12.128674 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1348/2672] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:12.137916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae1e6b-a77b-4af7-b43b-97a23343b14c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.138202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae1e6b-a77b-4af7-b43b-97a23343b14c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.138512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae1e6b-a77b-4af7-b43b-97a23343b14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.157818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2cae1e6b-a77b-4af7-b43b-97a23343b14c None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:12.159061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2cae1e6b-a77b-4af7-b43b-97a23343b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:12.168140 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1325/2673] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:12.172321 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761e3b0-ebb9-4381-9173-2f99b890c132 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.182546 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761e3b0-ebb9-4381-9173-2f99b890c132 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.187081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30f299-5a7a-4b41-8f61-35204ad7d952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.187963 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30f299-5a7a-4b41-8f61-35204ad7d952 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.188243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30f299-5a7a-4b41-8f61-35204ad7d952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.188513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30f299-5a7a-4b41-8f61-35204ad7d952 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.189209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30f299-5a7a-4b41-8f61-35204ad7d952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:18:12.189510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30f299-5a7a-4b41-8f61-35204ad7d952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.191263 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30f299-5a7a-4b41-8f61-35204ad7d952 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.203419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1349/2674] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:18:12.208248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae1e6b-a77b-4af7-b43b-97a23343b14c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.217657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae1e6b-a77b-4af7-b43b-97a23343b14c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.222395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f231872-1516-4bfd-9004-45d4cad3165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.223637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f231872-1516-4bfd-9004-45d4cad3165d admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.223911 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f231872-1516-4bfd-9004-45d4cad3165d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.224179 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f231872-1516-4bfd-9004-45d4cad3165d admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.224839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f231872-1516-4bfd-9004-45d4cad3165d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.226811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f231872-1516-4bfd-9004-45d4cad3165d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.253004 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1326/2675] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:18:12 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:12.257170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30f299-5a7a-4b41-8f61-35204ad7d952 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.267223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30f299-5a7a-4b41-8f61-35204ad7d952 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.322770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4db6ee-d42d-4036-9b90-43ea7dfe7cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.323379 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4db6ee-d42d-4036-9b90-43ea7dfe7cff admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.323655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4db6ee-d42d-4036-9b90-43ea7dfe7cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.323923 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4db6ee-d42d-4036-9b90-43ea7dfe7cff admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.324576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4db6ee-d42d-4036-9b90-43ea7dfe7cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.326474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4db6ee-d42d-4036-9b90-43ea7dfe7cff admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.349352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1350/2676] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:18:12 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:12.353611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f231872-1516-4bfd-9004-45d4cad3165d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.364414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f231872-1516-4bfd-9004-45d4cad3165d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.369529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c17f1b-c697-4053-bf25-3a7e5b2eded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.370147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c17f1b-c697-4053-bf25-3a7e5b2eded6 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.370422 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c17f1b-c697-4053-bf25-3a7e5b2eded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.370730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c17f1b-c697-4053-bf25-3a7e5b2eded6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.371626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c17f1b-c697-4053-bf25-3a7e5b2eded6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.373337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c17f1b-c697-4053-bf25-3a7e5b2eded6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.384274 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1327/2677] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:12.388105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4db6ee-d42d-4036-9b90-43ea7dfe7cff admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.398543 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4db6ee-d42d-4036-9b90-43ea7dfe7cff admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.403178 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf0979-4490-4259-9c99-e4f7c04915ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.403775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf0979-4490-4259-9c99-e4f7c04915ca admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.404055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf0979-4490-4259-9c99-e4f7c04915ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.404330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf0979-4490-4259-9c99-e4f7c04915ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.405024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf0979-4490-4259-9c99-e4f7c04915ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.406651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf0979-4490-4259-9c99-e4f7c04915ca admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.417561 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1351/2678] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:12.421595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c17f1b-c697-4053-bf25-3a7e5b2eded6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.431870 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c17f1b-c697-4053-bf25-3a7e5b2eded6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.436467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f914f-d3a4-46fa-9ff5-ec3138cef9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.437108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f914f-d3a4-46fa-9ff5-ec3138cef9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.437649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f914f-d3a4-46fa-9ff5-ec3138cef9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.437924 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f914f-d3a4-46fa-9ff5-ec3138cef9bf admin admin] PATH_INFO: `/v3/projects/6bfb8ef63bff4036beffe8201058c4e8/users/7d3d086a237047b0be9d9b9d6a9c206f/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.452198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f914f-d3a4-46fa-9ff5-ec3138cef9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfb8ef63bff4036beffe8201058c4e8, user_id=7d3d086a237047b0be9d9b9d6a9c206f, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.454933 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f914f-d3a4-46fa-9ff5-ec3138cef9bf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.468401 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1328/2679] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:12 2022] PUT /identity/v3/projects/6bfb8ef63bff4036beffe8201058c4e8/users/7d3d086a237047b0be9d9b9d6a9c206f/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:12.483004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e0c8-3ad2-417c-961d-19f34a192d30 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.483294 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e0c8-3ad2-417c-961d-19f34a192d30 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.483571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e0c8-3ad2-417c-961d-19f34a192d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.510211 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-05a4e0c8-3ad2-417c-961d-19f34a192d30 None None] MFA Rules not processed for user `7d3d086a237047b0be9d9b9d6a9c206f`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:12.511457 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-05a4e0c8-3ad2-417c-961d-19f34a192d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:12.574207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1352/2680] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:12.578635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f914f-d3a4-46fa-9ff5-ec3138cef9bf admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.639963 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f914f-d3a4-46fa-9ff5-ec3138cef9bf admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.644516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448ece6-1a46-4977-99f3-402568220bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.645670 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448ece6-1a46-4977-99f3-402568220bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.645946 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448ece6-1a46-4977-99f3-402568220bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.646214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448ece6-1a46-4977-99f3-402568220bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.646929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448ece6-1a46-4977-99f3-402568220bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.648796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448ece6-1a46-4977-99f3-402568220bd6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.663990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:12.677395 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1329/2681] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:18:12 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:12.681435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e0c8-3ad2-417c-961d-19f34a192d30 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.692733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e0c8-3ad2-417c-961d-19f34a192d30 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.740408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:12.758238 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04b1ee-e585-4008-89c1-22fa5e1fcd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.758940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04b1ee-e585-4008-89c1-22fa5e1fcd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.759224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04b1ee-e585-4008-89c1-22fa5e1fcd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.759500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04b1ee-e585-4008-89c1-22fa5e1fcd40 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.760182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04b1ee-e585-4008-89c1-22fa5e1fcd40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.762110 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04b1ee-e585-4008-89c1-22fa5e1fcd40 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.785967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1353/2682] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:18:12 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:12.790114 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448ece6-1a46-4977-99f3-402568220bd6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.800698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448ece6-1a46-4977-99f3-402568220bd6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.805335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250932d5-2667-4659-acb9-c1ebee52c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.805923 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250932d5-2667-4659-acb9-c1ebee52c045 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.806194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250932d5-2667-4659-acb9-c1ebee52c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.806480 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250932d5-2667-4659-acb9-c1ebee52c045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.807175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250932d5-2667-4659-acb9-c1ebee52c045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.808757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250932d5-2667-4659-acb9-c1ebee52c045 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.820281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1330/2683] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:18:12.824479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04b1ee-e585-4008-89c1-22fa5e1fcd40 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.835257 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04b1ee-e585-4008-89c1-22fa5e1fcd40 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.839908 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974ad2-0ab7-4bb3-b967-3f0d62bd5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.840554 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974ad2-0ab7-4bb3-b967-3f0d62bd5b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.840840 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974ad2-0ab7-4bb3-b967-3f0d62bd5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.841121 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974ad2-0ab7-4bb3-b967-3f0d62bd5b9f admin admin] PATH_INFO: `/v3/projects/9934b86bdb3347acb19a05b614586da8/users/8b6f74d5fe054628bb031021fb6d5f9e/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.856303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e974ad2-0ab7-4bb3-b967-3f0d62bd5b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9934b86bdb3347acb19a05b614586da8, user_id=8b6f74d5fe054628bb031021fb6d5f9e, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.859088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e974ad2-0ab7-4bb3-b967-3f0d62bd5b9f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:12.873444 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1354/2684] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:12 2022] PUT /identity/v3/projects/9934b86bdb3347acb19a05b614586da8/users/8b6f74d5fe054628bb031021fb6d5f9e/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:12.877520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250932d5-2667-4659-acb9-c1ebee52c045 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:12.890846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250932d5-2667-4659-acb9-c1ebee52c045 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:12.982873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0d7e4-a7d3-458c-931e-527ce24673b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:12.983920 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0d7e4-a7d3-458c-931e-527ce24673b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:12.984425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0d7e4-a7d3-458c-931e-527ce24673b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:12.984910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0d7e4-a7d3-458c-931e-527ce24673b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:12.986191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0d7e4-a7d3-458c-931e-527ce24673b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:12.989797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0d7e4-a7d3-458c-931e-527ce24673b1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:13.004860 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1331/2685] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:18:13.009757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974ad2-0ab7-4bb3-b967-3f0d62bd5b9f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:13.022208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974ad2-0ab7-4bb3-b967-3f0d62bd5b9f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:13.029486 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61086d12-1cc3-46ed-a7f5-08a95de6aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:13.030154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61086d12-1cc3-46ed-a7f5-08a95de6aad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:13.030454 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61086d12-1cc3-46ed-a7f5-08a95de6aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:13.030737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61086d12-1cc3-46ed-a7f5-08a95de6aad0 admin admin] PATH_INFO: `/v3/projects/9934b86bdb3347acb19a05b614586da8/users/8b6f74d5fe054628bb031021fb6d5f9e/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:13.032711 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61086d12-1cc3-46ed-a7f5-08a95de6aad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9934b86bdb3347acb19a05b614586da8, user_id=8b6f74d5fe054628bb031021fb6d5f9e, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:13.035464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61086d12-1cc3-46ed-a7f5-08a95de6aad0 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:13.049499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1355/2686] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:13 2022] PUT /identity/v3/projects/9934b86bdb3347acb19a05b614586da8/users/8b6f74d5fe054628bb031021fb6d5f9e/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:13.062214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ea77-ddcd-4d1d-bbdc-96c1692e3b0e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:13.063005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ea77-ddcd-4d1d-bbdc-96c1692e3b0e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:13.063460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ea77-ddcd-4d1d-bbdc-96c1692e3b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:13.100388 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-db66ea77-ddcd-4d1d-bbdc-96c1692e3b0e None None] MFA Rules not processed for user `8b6f74d5fe054628bb031021fb6d5f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:13.101619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-db66ea77-ddcd-4d1d-bbdc-96c1692e3b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:13.168778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1332/2687] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:13.179881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61086d12-1cc3-46ed-a7f5-08a95de6aad0 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:13.181567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-61086d12-1cc3-46ed-a7f5-08a95de6aad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:13.243330 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61086d12-1cc3-46ed-a7f5-08a95de6aad0 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:13.247622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8b646-d606-4ddf-8665-3faa16d3826a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:13.248340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8b646-d606-4ddf-8665-3faa16d3826a service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:13.248622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8b646-d606-4ddf-8665-3faa16d3826a service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:13.248892 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8b646-d606-4ddf-8665-3faa16d3826a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:13.307062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8b646-d606-4ddf-8665-3faa16d3826a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:13.308747 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8b646-d606-4ddf-8665-3faa16d3826a service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:13.318642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1356/2688] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:15.900327 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ea77-ddcd-4d1d-bbdc-96c1692e3b0e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:15.910034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ea77-ddcd-4d1d-bbdc-96c1692e3b0e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:15.913631 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9f45b-7ff7-4447-ab18-a87190839a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:15.914236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9f45b-7ff7-4447-ab18-a87190839a2b service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:15.914552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9f45b-7ff7-4447-ab18-a87190839a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:15.914832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9f45b-7ff7-4447-ab18-a87190839a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:15.923643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9f45b-7ff7-4447-ab18-a87190839a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:15.925065 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9f45b-7ff7-4447-ab18-a87190839a2b service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:15.935018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1333/2689] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:23.313915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=69,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:25.930716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=76 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:28.373394 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8b646-d606-4ddf-8665-3faa16d3826a service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:28.433373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8b646-d606-4ddf-8665-3faa16d3826a service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:28.438054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:28.438691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:28.438971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:28.439242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] PATH_INFO: `/v3/users/7d3d086a237047b0be9d9b9d6a9c206f` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:28.440461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3d086a237047b0be9d9b9d6a9c206f)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:28.442970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:28.493414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3d086a237047b0be9d9b9d6a9c206f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:28.494073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3d086a237047b0be9d9b9d6a9c206f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:28.501762 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3d086a237047b0be9d9b9d6a9c206f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:28.514343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3d086a237047b0be9d9b9d6a9c206f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:28.515007 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3d086a237047b0be9d9b9d6a9c206f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:28.527552 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1357/2690] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:28 2022] DELETE /identity/v3/users/7d3d086a237047b0be9d9b9d6a9c206f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:28.532044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6dd77-0aad-42a8-9bb7-98fc292d247f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:28.532534 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6dd77-0aad-42a8-9bb7-98fc292d247f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:28.532647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6dd77-0aad-42a8-9bb7-98fc292d247f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:28.552053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3ce6dd77-0aad-42a8-9bb7-98fc292d247f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:28.553260 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3ce6dd77-0aad-42a8-9bb7-98fc292d247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:28.737522 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1334/2691] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:18:28.747689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:28.749102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:28.818388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337d314-9a75-44d1-a80e-5dbfc50fcbde admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:28.821939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeeb7f-11c2-4282-8225-de77efb49b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:28.822580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeeb7f-11c2-4282-8225-de77efb49b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:28.822858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeeb7f-11c2-4282-8225-de77efb49b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:28.823125 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeeb7f-11c2-4282-8225-de77efb49b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:28.831817 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeeb7f-11c2-4282-8225-de77efb49b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:28.833328 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeeb7f-11c2-4282-8225-de77efb49b18 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:28.842498 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1358/2692] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:29.109466 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6dd77-0aad-42a8-9bb7-98fc292d247f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:29.110902 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3ce6dd77-0aad-42a8-9bb7-98fc292d247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:29.123318 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6dd77-0aad-42a8-9bb7-98fc292d247f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:29.127830 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:29.128459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:29.128729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:29.128996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] PATH_INFO: `/v3/projects/6bfb8ef63bff4036beffe8201058c4e8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:29.130158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfb8ef63bff4036beffe8201058c4e8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:29.132088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:29.177818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfb8ef63bff4036beffe8201058c4e8', 'request_id': 'req-f88ceffb-f506-4e19-aaac-be9028925ad3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.183626 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfb8ef63bff4036beffe8201058c4e8', 'request_id': 'req-f88ceffb-f506-4e19-aaac-be9028925ad3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.190293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfb8ef63bff4036beffe8201058c4e8', 'request_id': 'req-f88ceffb-f506-4e19-aaac-be9028925ad3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.202106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] The token cache is being invalidate because project 6bfb8ef63bff4036beffe8201058c4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:29.202389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.203030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.204512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1335/2693] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:29 2022] DELETE /identity/v3/projects/6bfb8ef63bff4036beffe8201058c4e8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:29.208578 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeeb7f-11c2-4282-8225-de77efb49b18 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:29.217976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeeb7f-11c2-4282-8225-de77efb49b18 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:29.235937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:29.274741 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:29.275296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:29.275574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:29.275846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] PATH_INFO: `/v3/users/8b6f74d5fe054628bb031021fb6d5f9e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:29.276995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6f74d5fe054628bb031021fb6d5f9e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:29.278953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:29.324732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6f74d5fe054628bb031021fb6d5f9e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.325380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6f74d5fe054628bb031021fb6d5f9e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.332329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6f74d5fe054628bb031021fb6d5f9e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.343943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6f74d5fe054628bb031021fb6d5f9e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.344560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-e134faff-3a7a-46db-9745-55660a512bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6f74d5fe054628bb031021fb6d5f9e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.356959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1359/2694] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:29 2022] DELETE /identity/v3/users/8b6f74d5fe054628bb031021fb6d5f9e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:29.616073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:29.618013 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:29.632600 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ceffb-f506-4e19-aaac-be9028925ad3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:29.688625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:29.689294 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:29.689575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:29.689841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] PATH_INFO: `/v3/projects/9934b86bdb3347acb19a05b614586da8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:29.691079 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9934b86bdb3347acb19a05b614586da8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:29.693059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:29.723237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:29.741115 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9934b86bdb3347acb19a05b614586da8', 'request_id': 'req-aa201510-1d25-4ecc-8193-076b90f3b49a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.746539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9934b86bdb3347acb19a05b614586da8', 'request_id': 'req-aa201510-1d25-4ecc-8193-076b90f3b49a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.752461 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9934b86bdb3347acb19a05b614586da8', 'request_id': 'req-aa201510-1d25-4ecc-8193-076b90f3b49a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.764233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] The token cache is being invalidate because project 9934b86bdb3347acb19a05b614586da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:29.764519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.765142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa201510-1d25-4ecc-8193-076b90f3b49a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:29.766649 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1336/2695] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:29 2022] DELETE /identity/v3/projects/9934b86bdb3347acb19a05b614586da8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:29.772139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7388e1-ce0b-4a0c-9e8d-8d51056f7e96 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:29.772612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7388e1-ce0b-4a0c-9e8d-8d51056f7e96 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:29.772709 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7388e1-ce0b-4a0c-9e8d-8d51056f7e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:29.792340 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-fd7388e1-ce0b-4a0c-9e8d-8d51056f7e96 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:29.793480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-fd7388e1-ce0b-4a0c-9e8d-8d51056f7e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:29.851531 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1360/2696] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:29.859134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef770b2-5474-42fe-8c26-13e908dfacfc None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:29.859419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef770b2-5474-42fe-8c26-13e908dfacfc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:29.859695 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef770b2-5474-42fe-8c26-13e908dfacfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:29.880244 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1ef770b2-5474-42fe-8c26-13e908dfacfc None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:29.881428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1ef770b2-5474-42fe-8c26-13e908dfacfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:29.889255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1337/2697] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:29.893370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7388e1-ce0b-4a0c-9e8d-8d51056f7e96 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:29.903730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7388e1-ce0b-4a0c-9e8d-8d51056f7e96 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:29.908319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c3a56-6eb1-4db9-bb5a-1546346d3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:29.908936 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3a56-6eb1-4db9-bb5a-1546346d3e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:29.909210 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3a56-6eb1-4db9-bb5a-1546346d3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:29.909474 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3a56-6eb1-4db9-bb5a-1546346d3e2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:29.910173 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c3a56-6eb1-4db9-bb5a-1546346d3e2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:18:29.910603 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c3a56-6eb1-4db9-bb5a-1546346d3e2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:29.912182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c3a56-6eb1-4db9-bb5a-1546346d3e2f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:29.923306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1361/2698] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:18:29.927499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef770b2-5474-42fe-8c26-13e908dfacfc None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:29.936525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef770b2-5474-42fe-8c26-13e908dfacfc None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:29.941276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76ecdf-47fe-4815-8955-3b3be8861841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:29.942432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76ecdf-47fe-4815-8955-3b3be8861841 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:29.942733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76ecdf-47fe-4815-8955-3b3be8861841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:29.943000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76ecdf-47fe-4815-8955-3b3be8861841 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:29.943655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76ecdf-47fe-4815-8955-3b3be8861841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:29.945550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76ecdf-47fe-4815-8955-3b3be8861841 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:29.971942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1338/2699] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:18:29 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:29.976050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c3a56-6eb1-4db9-bb5a-1546346d3e2f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:29.986155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c3a56-6eb1-4db9-bb5a-1546346d3e2f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.011448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:30.042576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f14b9-c4db-4cb4-85d7-c1d72a0440f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.043112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f14b9-c4db-4cb4-85d7-c1d72a0440f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.043394 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f14b9-c4db-4cb4-85d7-c1d72a0440f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.043673 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f14b9-c4db-4cb4-85d7-c1d72a0440f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.044326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f14b9-c4db-4cb4-85d7-c1d72a0440f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.046235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f14b9-c4db-4cb4-85d7-c1d72a0440f5 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.066682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1362/2700] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:18:29 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:18:30.071322 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76ecdf-47fe-4815-8955-3b3be8861841 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.081639 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76ecdf-47fe-4815-8955-3b3be8861841 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.086868 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f719e-be39-42f1-9004-88488e3e4853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.087467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f719e-be39-42f1-9004-88488e3e4853 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.087750 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f719e-be39-42f1-9004-88488e3e4853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.088049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f719e-be39-42f1-9004-88488e3e4853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.088738 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f719e-be39-42f1-9004-88488e3e4853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.090328 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f719e-be39-42f1-9004-88488e3e4853 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.100212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1339/2701] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:30.103899 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f14b9-c4db-4cb4-85d7-c1d72a0440f5 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.113839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f14b9-c4db-4cb4-85d7-c1d72a0440f5 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.118529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1071f3-6b33-4bb6-b864-a72982954308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.119132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1071f3-6b33-4bb6-b864-a72982954308 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.119409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1071f3-6b33-4bb6-b864-a72982954308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.119680 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1071f3-6b33-4bb6-b864-a72982954308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.120374 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1071f3-6b33-4bb6-b864-a72982954308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.121967 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1071f3-6b33-4bb6-b864-a72982954308 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.133023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1363/2702] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:30.137028 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f719e-be39-42f1-9004-88488e3e4853 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.147535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f719e-be39-42f1-9004-88488e3e4853 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.152150 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029fb7c-650f-426d-8255-8c154118196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.152792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029fb7c-650f-426d-8255-8c154118196b admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.153074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029fb7c-650f-426d-8255-8c154118196b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.153348 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029fb7c-650f-426d-8255-8c154118196b admin admin] PATH_INFO: `/v3/projects/1ef218327db0485796f3b0f7361d8795/users/c2a817fe39f940d6a607b35da976d801/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.167564 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029fb7c-650f-426d-8255-8c154118196b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef218327db0485796f3b0f7361d8795, user_id=c2a817fe39f940d6a607b35da976d801, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.170182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029fb7c-650f-426d-8255-8c154118196b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.184112 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1340/2703] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:30 2022] PUT /identity/v3/projects/1ef218327db0485796f3b0f7361d8795/users/c2a817fe39f940d6a607b35da976d801/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:30.195346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec3b0-8499-435d-bf0d-2aac3d91d7f6 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.195658 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec3b0-8499-435d-bf0d-2aac3d91d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.195935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec3b0-8499-435d-bf0d-2aac3d91d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.223708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-2ceec3b0-8499-435d-bf0d-2aac3d91d7f6 None None] MFA Rules not processed for user `c2a817fe39f940d6a607b35da976d801`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:30.224909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2ceec3b0-8499-435d-bf0d-2aac3d91d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:30.286496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1364/2704] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:30.291048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029fb7c-650f-426d-8255-8c154118196b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.351546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029fb7c-650f-426d-8255-8c154118196b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.356170 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01d82-b0a4-4d25-8397-5dabdc27cc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.356772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01d82-b0a4-4d25-8397-5dabdc27cc0c admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.357053 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01d82-b0a4-4d25-8397-5dabdc27cc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.357326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01d82-b0a4-4d25-8397-5dabdc27cc0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.357990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df01d82-b0a4-4d25-8397-5dabdc27cc0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.359910 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df01d82-b0a4-4d25-8397-5dabdc27cc0c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.385982 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1341/2705] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:18:30 2022] POST /identity/v3/projects => generated 401 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:30.389980 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec3b0-8499-435d-bf0d-2aac3d91d7f6 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.401324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec3b0-8499-435d-bf0d-2aac3d91d7f6 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.455304 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34954b-73a9-4065-8da1-b1fe3ed00953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.455904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34954b-73a9-4065-8da1-b1fe3ed00953 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.456200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34954b-73a9-4065-8da1-b1fe3ed00953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.456451 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34954b-73a9-4065-8da1-b1fe3ed00953 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.457122 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34954b-73a9-4065-8da1-b1fe3ed00953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.459646 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34954b-73a9-4065-8da1-b1fe3ed00953 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.480414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1365/2706] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:18:30 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:30.484385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01d82-b0a4-4d25-8397-5dabdc27cc0c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.494606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01d82-b0a4-4d25-8397-5dabdc27cc0c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.499158 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf441a4-d287-400b-9be7-5598a79e1a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.499760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf441a4-d287-400b-9be7-5598a79e1a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.500037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf441a4-d287-400b-9be7-5598a79e1a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.500304 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf441a4-d287-400b-9be7-5598a79e1a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.500991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf441a4-d287-400b-9be7-5598a79e1a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.502614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf441a4-d287-400b-9be7-5598a79e1a14 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.512494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1342/2707] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:30.516558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34954b-73a9-4065-8da1-b1fe3ed00953 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.526997 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34954b-73a9-4065-8da1-b1fe3ed00953 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.531461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86d269-07b9-4f55-afe6-d56d4948b64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.532097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86d269-07b9-4f55-afe6-d56d4948b64c admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.532371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86d269-07b9-4f55-afe6-d56d4948b64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.532642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86d269-07b9-4f55-afe6-d56d4948b64c admin admin] PATH_INFO: `/v3/projects/8d5429ee4ea5473e83c9adc1b2c16f35/users/105215c5c0544ac4a3d637dfa64eab29/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.547397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86d269-07b9-4f55-afe6-d56d4948b64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5429ee4ea5473e83c9adc1b2c16f35, user_id=105215c5c0544ac4a3d637dfa64eab29, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.550046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86d269-07b9-4f55-afe6-d56d4948b64c admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.562240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1366/2708] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:30 2022] PUT /identity/v3/projects/8d5429ee4ea5473e83c9adc1b2c16f35/users/105215c5c0544ac4a3d637dfa64eab29/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:30.566216 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf441a4-d287-400b-9be7-5598a79e1a14 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.576426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf441a4-d287-400b-9be7-5598a79e1a14 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.596343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:30.633182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc1a4f-2027-4839-aba6-1ae42a2572cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.633784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc1a4f-2027-4839-aba6-1ae42a2572cc admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.633990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc1a4f-2027-4839-aba6-1ae42a2572cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.634262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc1a4f-2027-4839-aba6-1ae42a2572cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.634979 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc1a4f-2027-4839-aba6-1ae42a2572cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.636547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc1a4f-2027-4839-aba6-1ae42a2572cc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.646546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1343/2709] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:30.650568 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86d269-07b9-4f55-afe6-d56d4948b64c admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.655914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:30.662800 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86d269-07b9-4f55-afe6-d56d4948b64c admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.667701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d0ece-bdbc-4cd2-a290-c31bceb5487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.668342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0ece-bdbc-4cd2-a290-c31bceb5487b admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.668622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0ece-bdbc-4cd2-a290-c31bceb5487b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.668918 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0ece-bdbc-4cd2-a290-c31bceb5487b admin admin] PATH_INFO: `/v3/projects/8d5429ee4ea5473e83c9adc1b2c16f35/users/105215c5c0544ac4a3d637dfa64eab29/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.670878 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d0ece-bdbc-4cd2-a290-c31bceb5487b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5429ee4ea5473e83c9adc1b2c16f35, user_id=105215c5c0544ac4a3d637dfa64eab29, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.673501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d0ece-bdbc-4cd2-a290-c31bceb5487b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.683560 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1367/2710] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:30 2022] PUT /identity/v3/projects/8d5429ee4ea5473e83c9adc1b2c16f35/users/105215c5c0544ac4a3d637dfa64eab29/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:30.695321 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7150f-e991-420a-aaf0-f313d75c912b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.695606 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7150f-e991-420a-aaf0-f313d75c912b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.695886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7150f-e991-420a-aaf0-f313d75c912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.724945 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-efd7150f-e991-420a-aaf0-f313d75c912b None None] MFA Rules not processed for user `105215c5c0544ac4a3d637dfa64eab29`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:30.726131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-efd7150f-e991-420a-aaf0-f313d75c912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:30.795450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1344/2711] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:30.806695 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d0ece-bdbc-4cd2-a290-c31bceb5487b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.808556 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7b0d0ece-bdbc-4cd2-a290-c31bceb5487b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:30.866023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d0ece-bdbc-4cd2-a290-c31bceb5487b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.869653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520dde-ce1a-4528-b5f9-644ebc9e5e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.870253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520dde-ce1a-4528-b5f9-644ebc9e5e7f service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.870564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520dde-ce1a-4528-b5f9-644ebc9e5e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.870837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520dde-ce1a-4528-b5f9-644ebc9e5e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:30.880416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a520dde-ce1a-4528-b5f9-644ebc9e5e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:30.881837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a520dde-ce1a-4528-b5f9-644ebc9e5e7f service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:30.891096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1368/2712] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:30 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:30.963543 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7150f-e991-420a-aaf0-f313d75c912b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:30.973791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7150f-e991-420a-aaf0-f313d75c912b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:30.977471 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdbc22-0aac-4a16-89e1-07724df10819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:30.978077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdbc22-0aac-4a16-89e1-07724df10819 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:30.978354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdbc22-0aac-4a16-89e1-07724df10819 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:30.978658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdbc22-0aac-4a16-89e1-07724df10819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:31.033618 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdbc22-0aac-4a16-89e1-07724df10819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:31.035125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdbc22-0aac-4a16-89e1-07724df10819 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:31.043878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1345/2713] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:35.069180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520dde-ce1a-4528-b5f9-644ebc9e5e7f service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:35.128237 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520dde-ce1a-4528-b5f9-644ebc9e5e7f service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:35.133186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:35.133802 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:35.134081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:35.134352 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] PATH_INFO: `/v3/users/c2a817fe39f940d6a607b35da976d801` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:35.135527 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a817fe39f940d6a607b35da976d801)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:35.137435 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:35.181609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a817fe39f940d6a607b35da976d801'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.182187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a817fe39f940d6a607b35da976d801'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.188970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a817fe39f940d6a607b35da976d801'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.201972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a817fe39f940d6a607b35da976d801'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.202637 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a817fe39f940d6a607b35da976d801'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.214972 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1369/2714] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:35 2022] DELETE /identity/v3/users/c2a817fe39f940d6a607b35da976d801 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:18:35.219425 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de622ec-ba0d-4668-8989-fd72f4f2c5e0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:35.219922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de622ec-ba0d-4668-8989-fd72f4f2c5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:35.220021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de622ec-ba0d-4668-8989-fd72f4f2c5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:35.238372 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5de622ec-ba0d-4668-8989-fd72f4f2c5e0 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:35.239595 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5de622ec-ba0d-4668-8989-fd72f4f2c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:35.279250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:35.297955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1346/2715] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:35.307732 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:35.309126 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:35.323380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:35.375691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb9884-3360-490c-a857-7a35f01cbc0b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:35.379524 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1db62-7a06-4c16-b598-bb68798c925d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:35.380085 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1db62-7a06-4c16-b598-bb68798c925d service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:35.380363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1db62-7a06-4c16-b598-bb68798c925d service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:35.380635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1db62-7a06-4c16-b598-bb68798c925d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:35.391762 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1db62-7a06-4c16-b598-bb68798c925d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:35.393192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1db62-7a06-4c16-b598-bb68798c925d service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:35.403150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1370/2716] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:35.697926 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de622ec-ba0d-4668-8989-fd72f4f2c5e0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:35.699407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5de622ec-ba0d-4668-8989-fd72f4f2c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:35.711500 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de622ec-ba0d-4668-8989-fd72f4f2c5e0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:35.717797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:35.718637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:35.719051 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:35.719331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] PATH_INFO: `/v3/projects/1ef218327db0485796f3b0f7361d8795` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:35.720565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef218327db0485796f3b0f7361d8795)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:35.722550 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:35.772495 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef218327db0485796f3b0f7361d8795', 'request_id': 'req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.777906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef218327db0485796f3b0f7361d8795', 'request_id': 'req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.785905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef218327db0485796f3b0f7361d8795', 'request_id': 'req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.799131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] The token cache is being invalidate because project 1ef218327db0485796f3b0f7361d8795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:35.799419 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.800044 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.801533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1347/2717] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:35 2022] DELETE /identity/v3/projects/1ef218327db0485796f3b0f7361d8795 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:35.806234 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1db62-7a06-4c16-b598-bb68798c925d service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:35.816283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1db62-7a06-4c16-b598-bb68798c925d service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:35.872710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:35.873354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:35.873636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:35.873913 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] PATH_INFO: `/v3/users/105215c5c0544ac4a3d637dfa64eab29` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:35.875140 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105215c5c0544ac4a3d637dfa64eab29)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:35.877162 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:35.924638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105215c5c0544ac4a3d637dfa64eab29'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.925317 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105215c5c0544ac4a3d637dfa64eab29'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.934628 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105215c5c0544ac4a3d637dfa64eab29'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.946795 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105215c5c0544ac4a3d637dfa64eab29'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.947432 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-853fb530-8bf3-4742-be46-32a440b808a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105215c5c0544ac4a3d637dfa64eab29'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:35.964453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1371/2718] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:35 2022] DELETE /identity/v3/users/105215c5c0544ac4a3d637dfa64eab29 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:36.259193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:36.260609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:36.274075 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b95be-6db1-43b8-b21a-7a5e8f4c75bb admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:36.330799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:36.331440 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:36.331720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:36.331996 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] PATH_INFO: `/v3/projects/8d5429ee4ea5473e83c9adc1b2c16f35` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:36.333147 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5429ee4ea5473e83c9adc1b2c16f35)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:36.335104 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:36.379197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5429ee4ea5473e83c9adc1b2c16f35', 'request_id': 'req-db5e36bf-a228-48e7-b1eb-bd371792a4a6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:36.385088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5429ee4ea5473e83c9adc1b2c16f35', 'request_id': 'req-db5e36bf-a228-48e7-b1eb-bd371792a4a6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:36.391213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5429ee4ea5473e83c9adc1b2c16f35', 'request_id': 'req-db5e36bf-a228-48e7-b1eb-bd371792a4a6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:36.399164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:36.405061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] The token cache is being invalidate because project 8d5429ee4ea5473e83c9adc1b2c16f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:36.405519 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:36.406619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-db5e36bf-a228-48e7-b1eb-bd371792a4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:36.408485 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1348/2719] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:36 2022] DELETE /identity/v3/projects/8d5429ee4ea5473e83c9adc1b2c16f35 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:36.413115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c5845-7771-4e78-b7c5-e8d82aa94bd9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:36.413570 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c5845-7771-4e78-b7c5-e8d82aa94bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:36.413666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c5845-7771-4e78-b7c5-e8d82aa94bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:36.433248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-6a3c5845-7771-4e78-b7c5-e8d82aa94bd9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:36.434373 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6a3c5845-7771-4e78-b7c5-e8d82aa94bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:36.463165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:36.495423 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1372/2720] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:36.503096 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d49d52-3608-48f4-ac7a-98553ec7510b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:36.503385 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d49d52-3608-48f4-ac7a-98553ec7510b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:36.503657 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d49d52-3608-48f4-ac7a-98553ec7510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:36.523562 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e9d49d52-3608-48f4-ac7a-98553ec7510b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:36.524762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e9d49d52-3608-48f4-ac7a-98553ec7510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:36.533142 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1349/2721] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:36.537950 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c5845-7771-4e78-b7c5-e8d82aa94bd9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:36.547701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c5845-7771-4e78-b7c5-e8d82aa94bd9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:36.552208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7294e6-a892-49fa-9f6f-376653f1957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:36.553430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7294e6-a892-49fa-9f6f-376653f1957d admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:36.553703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7294e6-a892-49fa-9f6f-376653f1957d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:36.553971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7294e6-a892-49fa-9f6f-376653f1957d admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:36.554689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7294e6-a892-49fa-9f6f-376653f1957d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:18:36.554988 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7294e6-a892-49fa-9f6f-376653f1957d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:36.556571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7294e6-a892-49fa-9f6f-376653f1957d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:36.568254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1373/2722] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:18:36.572331 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d49d52-3608-48f4-ac7a-98553ec7510b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:36.581350 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d49d52-3608-48f4-ac7a-98553ec7510b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:36.586019 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62664b8-0ae9-4159-acee-571d7f664f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:36.586645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62664b8-0ae9-4159-acee-571d7f664f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:36.586925 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62664b8-0ae9-4159-acee-571d7f664f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:36.587198 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62664b8-0ae9-4159-acee-571d7f664f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:36.587876 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62664b8-0ae9-4159-acee-571d7f664f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:36.589735 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62664b8-0ae9-4159-acee-571d7f664f0b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:36.616988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1350/2723] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:18:36 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:36.621015 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7294e6-a892-49fa-9f6f-376653f1957d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:36.630796 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7294e6-a892-49fa-9f6f-376653f1957d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:36.684599 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cf9ca-8022-4d82-9282-e5beeb2d6070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:36.685130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cf9ca-8022-4d82-9282-e5beeb2d6070 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:36.685407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cf9ca-8022-4d82-9282-e5beeb2d6070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:36.685680 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cf9ca-8022-4d82-9282-e5beeb2d6070 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:36.686329 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cf9ca-8022-4d82-9282-e5beeb2d6070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:36.688564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cf9ca-8022-4d82-9282-e5beeb2d6070 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:36.708393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1374/2724] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:18:36 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:36.712489 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62664b8-0ae9-4159-acee-571d7f664f0b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:36.723190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62664b8-0ae9-4159-acee-571d7f664f0b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:36.728233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122348-fd14-4a6c-a3af-11b66dbf0503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:36.728831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122348-fd14-4a6c-a3af-11b66dbf0503 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:36.729109 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122348-fd14-4a6c-a3af-11b66dbf0503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:36.729379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122348-fd14-4a6c-a3af-11b66dbf0503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:36.730066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24122348-fd14-4a6c-a3af-11b66dbf0503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:36.731694 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24122348-fd14-4a6c-a3af-11b66dbf0503 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:36.742057 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1351/2725] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:36.745860 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cf9ca-8022-4d82-9282-e5beeb2d6070 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:36.755688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cf9ca-8022-4d82-9282-e5beeb2d6070 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:36.760165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b8944-9f70-44ee-b468-2dcb14860c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:36.760756 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8944-9f70-44ee-b468-2dcb14860c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:36.761030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8944-9f70-44ee-b468-2dcb14860c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:36.761302 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8944-9f70-44ee-b468-2dcb14860c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:36.761985 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b8944-9f70-44ee-b468-2dcb14860c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:36.763644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b8944-9f70-44ee-b468-2dcb14860c6d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:36.773837 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1375/2726] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:36.777598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122348-fd14-4a6c-a3af-11b66dbf0503 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:36.788010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122348-fd14-4a6c-a3af-11b66dbf0503 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:36.792548 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e3500-69f3-4169-b71a-aab3a1649fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:36.793192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e3500-69f3-4169-b71a-aab3a1649fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:36.793468 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e3500-69f3-4169-b71a-aab3a1649fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:36.793759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e3500-69f3-4169-b71a-aab3a1649fa8 admin admin] PATH_INFO: `/v3/projects/54804d54d4074fa0a698d40fcad8e47b/users/d9157d7af6b34750b8bc59129252499f/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:36.809533 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e3500-69f3-4169-b71a-aab3a1649fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54804d54d4074fa0a698d40fcad8e47b, user_id=d9157d7af6b34750b8bc59129252499f, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:36.816796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e3500-69f3-4169-b71a-aab3a1649fa8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:36.835026 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1352/2727] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:36 2022] PUT /identity/v3/projects/54804d54d4074fa0a698d40fcad8e47b/users/d9157d7af6b34750b8bc59129252499f/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:36.846342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4c21-6208-4384-92f4-490ea0a0a157 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:36.846662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4c21-6208-4384-92f4-490ea0a0a157 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:36.846938 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4c21-6208-4384-92f4-490ea0a0a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:36.875270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-b8cd4c21-6208-4384-92f4-490ea0a0a157 None None] MFA Rules not processed for user `d9157d7af6b34750b8bc59129252499f`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:36.876470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b8cd4c21-6208-4384-92f4-490ea0a0a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:36.940255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1376/2728] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:36.944599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e3500-69f3-4169-b71a-aab3a1649fa8 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:37.005432 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e3500-69f3-4169-b71a-aab3a1649fa8 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:37.010036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232df2e-f56e-42ed-932c-e245372f92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:37.010720 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232df2e-f56e-42ed-932c-e245372f92c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:37.011022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232df2e-f56e-42ed-932c-e245372f92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:37.011289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232df2e-f56e-42ed-932c-e245372f92c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:37.011944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232df2e-f56e-42ed-932c-e245372f92c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:37.013811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232df2e-f56e-42ed-932c-e245372f92c6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:37.039929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1353/2729] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:18:36 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:37.043914 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd4c21-6208-4384-92f4-490ea0a0a157 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:37.054906 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd4c21-6208-4384-92f4-490ea0a0a157 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:37.089471 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:37.120575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b62cc-21ba-4f67-9c64-96eb701ba729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:37.121183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b62cc-21ba-4f67-9c64-96eb701ba729 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:37.121460 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b62cc-21ba-4f67-9c64-96eb701ba729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:37.121730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b62cc-21ba-4f67-9c64-96eb701ba729 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:37.122388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b62cc-21ba-4f67-9c64-96eb701ba729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:37.124319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b62cc-21ba-4f67-9c64-96eb701ba729 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:37.143978 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1377/2730] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:18:37 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:37.148475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232df2e-f56e-42ed-932c-e245372f92c6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:37.158539 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232df2e-f56e-42ed-932c-e245372f92c6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:37.163654 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf07be1-fc0c-413f-8f5a-af768b9e04bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:37.164247 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf07be1-fc0c-413f-8f5a-af768b9e04bf admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:37.164522 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf07be1-fc0c-413f-8f5a-af768b9e04bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:37.164789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf07be1-fc0c-413f-8f5a-af768b9e04bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:37.165469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf07be1-fc0c-413f-8f5a-af768b9e04bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:37.167074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf07be1-fc0c-413f-8f5a-af768b9e04bf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:37.178540 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1354/2731] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:37.182409 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b62cc-21ba-4f67-9c64-96eb701ba729 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:37.193049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b62cc-21ba-4f67-9c64-96eb701ba729 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:37.197814 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1ba1-a5b3-42aa-b748-23fa34d8dbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:37.198489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1ba1-a5b3-42aa-b748-23fa34d8dbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:37.198770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1ba1-a5b3-42aa-b748-23fa34d8dbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:37.199045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1ba1-a5b3-42aa-b748-23fa34d8dbe5 admin admin] PATH_INFO: `/v3/projects/752d0f740bf84224ae013f6b8abf9075/users/e5d35f44c9824a99bb173a2961fedc35/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:37.214581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f1ba1-a5b3-42aa-b748-23fa34d8dbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=752d0f740bf84224ae013f6b8abf9075, user_id=e5d35f44c9824a99bb173a2961fedc35, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:37.217242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f1ba1-a5b3-42aa-b748-23fa34d8dbe5 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:37.230461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1378/2732] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:37 2022] PUT /identity/v3/projects/752d0f740bf84224ae013f6b8abf9075/users/e5d35f44c9824a99bb173a2961fedc35/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:37.234360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf07be1-fc0c-413f-8f5a-af768b9e04bf admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:37.244106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf07be1-fc0c-413f-8f5a-af768b9e04bf admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:37.298866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1176c2-88f7-4acf-8687-7c95b00240a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:37.299484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1176c2-88f7-4acf-8687-7c95b00240a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:37.299741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1176c2-88f7-4acf-8687-7c95b00240a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:37.300014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1176c2-88f7-4acf-8687-7c95b00240a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:37.300704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1176c2-88f7-4acf-8687-7c95b00240a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:37.302623 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1176c2-88f7-4acf-8687-7c95b00240a2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:37.312661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1355/2733] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:37.316846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1ba1-a5b3-42aa-b748-23fa34d8dbe5 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:37.327541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1ba1-a5b3-42aa-b748-23fa34d8dbe5 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:37.332064 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187ddf7-75b4-41a7-b1cd-0839b7df5cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:37.332704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187ddf7-75b4-41a7-b1cd-0839b7df5cac admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:37.332983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187ddf7-75b4-41a7-b1cd-0839b7df5cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:37.333256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187ddf7-75b4-41a7-b1cd-0839b7df5cac admin admin] PATH_INFO: `/v3/projects/752d0f740bf84224ae013f6b8abf9075/users/e5d35f44c9824a99bb173a2961fedc35/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:37.335763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187ddf7-75b4-41a7-b1cd-0839b7df5cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=752d0f740bf84224ae013f6b8abf9075, user_id=e5d35f44c9824a99bb173a2961fedc35, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:37.338416 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187ddf7-75b4-41a7-b1cd-0839b7df5cac admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:37.348696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1379/2734] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:37 2022] PUT /identity/v3/projects/752d0f740bf84224ae013f6b8abf9075/users/e5d35f44c9824a99bb173a2961fedc35/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:37.414450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505045d-a020-4bc2-a3a1-78fdab616e3e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:37.414758 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505045d-a020-4bc2-a3a1-78fdab616e3e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:37.415031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505045d-a020-4bc2-a3a1-78fdab616e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:37.423152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:37.445134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4505045d-a020-4bc2-a3a1-78fdab616e3e None None] MFA Rules not processed for user `e5d35f44c9824a99bb173a2961fedc35`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:37.446234 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4505045d-a020-4bc2-a3a1-78fdab616e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:37.519355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1356/2735] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:37.531153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187ddf7-75b4-41a7-b1cd-0839b7df5cac admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:37.532933 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6187ddf7-75b4-41a7-b1cd-0839b7df5cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:37.590647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187ddf7-75b4-41a7-b1cd-0839b7df5cac admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:37.594300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778f1b0-87a9-44be-8f23-c57a59401cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:37.594937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f1b0-87a9-44be-8f23-c57a59401cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:37.595216 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f1b0-87a9-44be-8f23-c57a59401cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:37.595491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f1b0-87a9-44be-8f23-c57a59401cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:37.604627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778f1b0-87a9-44be-8f23-c57a59401cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:37.606046 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778f1b0-87a9-44be-8f23-c57a59401cd8 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:37.615882 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1380/2736] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:37.696224 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505045d-a020-4bc2-a3a1-78fdab616e3e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:37.705777 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505045d-a020-4bc2-a3a1-78fdab616e3e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:37.709370 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53368e3-5883-439d-a9f6-5fbfc2de446a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:37.709972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53368e3-5883-439d-a9f6-5fbfc2de446a service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:37.710249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53368e3-5883-439d-a9f6-5fbfc2de446a service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:37.710551 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53368e3-5883-439d-a9f6-5fbfc2de446a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:37.775417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53368e3-5883-439d-a9f6-5fbfc2de446a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:37.776835 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53368e3-5883-439d-a9f6-5fbfc2de446a service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:37.785668 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1357/2737] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:42.447204 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778f1b0-87a9-44be-8f23-c57a59401cd8 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:42.506713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778f1b0-87a9-44be-8f23-c57a59401cd8 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:42.511180 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:42.511797 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:42.512073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:42.512342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] PATH_INFO: `/v3/users/d9157d7af6b34750b8bc59129252499f` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:42.513501 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9157d7af6b34750b8bc59129252499f)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:42.515453 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:42.542737 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:42.562113 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9157d7af6b34750b8bc59129252499f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:42.563033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9157d7af6b34750b8bc59129252499f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:42.569708 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9157d7af6b34750b8bc59129252499f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:42.581320 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9157d7af6b34750b8bc59129252499f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:42.581942 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9157d7af6b34750b8bc59129252499f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:42.594360 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1381/2738] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:42 2022] DELETE /identity/v3/users/d9157d7af6b34750b8bc59129252499f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:42.599288 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ebf8f-f912-4e39-bd2d-38e56857b21f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:42.599756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ebf8f-f912-4e39-bd2d-38e56857b21f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:42.599861 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ebf8f-f912-4e39-bd2d-38e56857b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:42.619610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-467ebf8f-f912-4e39-bd2d-38e56857b21f None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:42.620796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-467ebf8f-f912-4e39-bd2d-38e56857b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:42.676662 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1358/2739] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:42.686887 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:42.688538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:42.745966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97533b17-6c83-40c7-b63f-1f6eb60edc15 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:42.749636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bdc2b-7aa3-428f-8e1a-3260b2573d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:42.750244 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bdc2b-7aa3-428f-8e1a-3260b2573d37 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:42.750563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bdc2b-7aa3-428f-8e1a-3260b2573d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:42.750838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bdc2b-7aa3-428f-8e1a-3260b2573d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:42.759733 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bdc2b-7aa3-428f-8e1a-3260b2573d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:42.761160 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bdc2b-7aa3-428f-8e1a-3260b2573d37 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:42.770508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1382/2740] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:43.054505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ebf8f-f912-4e39-bd2d-38e56857b21f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:43.056059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-467ebf8f-f912-4e39-bd2d-38e56857b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:43.069072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ebf8f-f912-4e39-bd2d-38e56857b21f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:43.073935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:43.074614 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:43.074892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:43.075164 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] PATH_INFO: `/v3/projects/54804d54d4074fa0a698d40fcad8e47b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:43.076347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54804d54d4074fa0a698d40fcad8e47b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:43.078248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:43.104424 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:43.126363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54804d54d4074fa0a698d40fcad8e47b', 'request_id': 'req-178e4304-4c32-41a3-9f8e-c33238a7c926'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.131725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54804d54d4074fa0a698d40fcad8e47b', 'request_id': 'req-178e4304-4c32-41a3-9f8e-c33238a7c926'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.137793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54804d54d4074fa0a698d40fcad8e47b', 'request_id': 'req-178e4304-4c32-41a3-9f8e-c33238a7c926'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.150546 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] The token cache is being invalidate because project 54804d54d4074fa0a698d40fcad8e47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:43.150831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.151477 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.152965 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1359/2741] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:43 2022] DELETE /identity/v3/projects/54804d54d4074fa0a698d40fcad8e47b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:43.157111 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bdc2b-7aa3-428f-8e1a-3260b2573d37 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:43.167263 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bdc2b-7aa3-428f-8e1a-3260b2573d37 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:43.223220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:43.223843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:43.224119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:43.224386 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] PATH_INFO: `/v3/users/e5d35f44c9824a99bb173a2961fedc35` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:43.225511 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d35f44c9824a99bb173a2961fedc35)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:43.227488 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:43.271743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d35f44c9824a99bb173a2961fedc35'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.272392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d35f44c9824a99bb173a2961fedc35'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.274657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:43.281004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d35f44c9824a99bb173a2961fedc35'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.293437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d35f44c9824a99bb173a2961fedc35'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.294134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c82c72c2-50e4-4ff0-89cf-d954c518eef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d35f44c9824a99bb173a2961fedc35'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.306388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1383/2742] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:43 2022] DELETE /identity/v3/users/e5d35f44c9824a99bb173a2961fedc35 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:43.581951 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:43.583415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:43.598894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e4304-4c32-41a3-9f8e-c33238a7c926 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:43.655429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:43.656101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:43.656332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:43.656609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] PATH_INFO: `/v3/projects/752d0f740bf84224ae013f6b8abf9075` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:43.657764 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=752d0f740bf84224ae013f6b8abf9075)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:43.659704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:43.705514 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752d0f740bf84224ae013f6b8abf9075', 'request_id': 'req-65fe35e1-9127-4dcd-987d-b84c5502fc45'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.710940 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752d0f740bf84224ae013f6b8abf9075', 'request_id': 'req-65fe35e1-9127-4dcd-987d-b84c5502fc45'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.716941 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752d0f740bf84224ae013f6b8abf9075', 'request_id': 'req-65fe35e1-9127-4dcd-987d-b84c5502fc45'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.731088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] The token cache is being invalidate because project 752d0f740bf84224ae013f6b8abf9075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:43.731374 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.732003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-65fe35e1-9127-4dcd-987d-b84c5502fc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:43.733495 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1360/2743] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:43 2022] DELETE /identity/v3/projects/752d0f740bf84224ae013f6b8abf9075 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:43.738566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13241a0-3f3e-48bb-bb18-50671cfbf7b7 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:43.739041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13241a0-3f3e-48bb-bb18-50671cfbf7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:43.739147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13241a0-3f3e-48bb-bb18-50671cfbf7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:43.759228 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d13241a0-3f3e-48bb-bb18-50671cfbf7b7 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:43.760404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d13241a0-3f3e-48bb-bb18-50671cfbf7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:43.817640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1384/2744] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:43.825759 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d521c-522c-4630-81f9-07348a71904e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:43.826114 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d521c-522c-4630-81f9-07348a71904e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:43.826498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d521c-522c-4630-81f9-07348a71904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:43.846389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2a6d521c-522c-4630-81f9-07348a71904e None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:43.847665 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2a6d521c-522c-4630-81f9-07348a71904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:43.855673 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1361/2745] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:43.859994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13241a0-3f3e-48bb-bb18-50671cfbf7b7 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:43.870090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13241a0-3f3e-48bb-bb18-50671cfbf7b7 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:43.874659 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e448b-3805-4457-a4f0-6179da4c8bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:43.875266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e448b-3805-4457-a4f0-6179da4c8bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:43.875549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e448b-3805-4457-a4f0-6179da4c8bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:43.875820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e448b-3805-4457-a4f0-6179da4c8bf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:43.876536 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e448b-3805-4457-a4f0-6179da4c8bf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:18:43.876839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e448b-3805-4457-a4f0-6179da4c8bf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:43.878459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e448b-3805-4457-a4f0-6179da4c8bf6 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:43.890454 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1385/2746] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 02:18:43.894757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d521c-522c-4630-81f9-07348a71904e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:43.904059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d521c-522c-4630-81f9-07348a71904e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:43.908959 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8c48a-ca81-44dd-bbb1-65e02c5e7a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:43.909561 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c48a-ca81-44dd-bbb1-65e02c5e7a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:43.909841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c48a-ca81-44dd-bbb1-65e02c5e7a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:43.910117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c48a-ca81-44dd-bbb1-65e02c5e7a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:43.910817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8c48a-ca81-44dd-bbb1-65e02c5e7a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:43.912716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8c48a-ca81-44dd-bbb1-65e02c5e7a4c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:43.939864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1362/2747] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:18:43 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:43.944016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e448b-3805-4457-a4f0-6179da4c8bf6 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:43.954715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e448b-3805-4457-a4f0-6179da4c8bf6 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:44.010472 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65fabc-3fbd-467f-861b-b31b131c27eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:44.011038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65fabc-3fbd-467f-861b-b31b131c27eb admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:44.011313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65fabc-3fbd-467f-861b-b31b131c27eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:44.011584 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65fabc-3fbd-467f-861b-b31b131c27eb admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:44.012241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65fabc-3fbd-467f-861b-b31b131c27eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:44.014147 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65fabc-3fbd-467f-861b-b31b131c27eb admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:44.034297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1386/2748] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:18:43 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:18:44.038414 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8c48a-ca81-44dd-bbb1-65e02c5e7a4c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:44.048611 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8c48a-ca81-44dd-bbb1-65e02c5e7a4c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:44.053263 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de32e5-49a7-4dbb-9d01-7b7354067bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:44.053885 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de32e5-49a7-4dbb-9d01-7b7354067bed admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:44.054168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de32e5-49a7-4dbb-9d01-7b7354067bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:44.054460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de32e5-49a7-4dbb-9d01-7b7354067bed admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:44.055167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de32e5-49a7-4dbb-9d01-7b7354067bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:44.056747 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de32e5-49a7-4dbb-9d01-7b7354067bed admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:44.066742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1363/2749] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:44.070881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65fabc-3fbd-467f-861b-b31b131c27eb admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:44.080491 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65fabc-3fbd-467f-861b-b31b131c27eb admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:44.085004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3d840-1d32-44ca-8c08-f15c17b8ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:44.086199 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3d840-1d32-44ca-8c08-f15c17b8ba0f admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:44.086502 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3d840-1d32-44ca-8c08-f15c17b8ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:44.086775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3d840-1d32-44ca-8c08-f15c17b8ba0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:44.087458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3d840-1d32-44ca-8c08-f15c17b8ba0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:44.089023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3d840-1d32-44ca-8c08-f15c17b8ba0f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:44.099245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1387/2750] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:18:44.103084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de32e5-49a7-4dbb-9d01-7b7354067bed admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:44.108203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:44.114499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de32e5-49a7-4dbb-9d01-7b7354067bed admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:44.119948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79754b-6cc0-4f1b-8bca-fbbdd0175f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:44.120599 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79754b-6cc0-4f1b-8bca-fbbdd0175f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:44.120914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79754b-6cc0-4f1b-8bca-fbbdd0175f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:44.121193 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79754b-6cc0-4f1b-8bca-fbbdd0175f93 admin admin] PATH_INFO: `/v3/projects/f4649e71f6354d89ba607c2d50e8fbb3/users/0453a9d5bb63454bbf6b52e7602cef17/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:44.136929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79754b-6cc0-4f1b-8bca-fbbdd0175f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4649e71f6354d89ba607c2d50e8fbb3, user_id=0453a9d5bb63454bbf6b52e7602cef17, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:44.139619 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79754b-6cc0-4f1b-8bca-fbbdd0175f93 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:44.152255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1364/2751] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:18:44 2022] PUT /identity/v3/projects/f4649e71f6354d89ba607c2d50e8fbb3/users/0453a9d5bb63454bbf6b52e7602cef17/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:44.163565 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1436e-76bd-4bc5-bee1-68b300993c35 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:44.163847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1436e-76bd-4bc5-bee1-68b300993c35 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:44.164116 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1436e-76bd-4bc5-bee1-68b300993c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:44.190855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-8ec1436e-76bd-4bc5-bee1-68b300993c35 None None] MFA Rules not processed for user `0453a9d5bb63454bbf6b52e7602cef17`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:44.192049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8ec1436e-76bd-4bc5-bee1-68b300993c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:44.211073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:44.260470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1388/2752] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:44.271156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79754b-6cc0-4f1b-8bca-fbbdd0175f93 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:44.272880 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7e79754b-6cc0-4f1b-8bca-fbbdd0175f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:44.331005 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79754b-6cc0-4f1b-8bca-fbbdd0175f93 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:44.334708 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4563e-88f3-44d1-a295-ab74b4d59d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:44.335832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4563e-88f3-44d1-a295-ab74b4d59d6b service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:44.336113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4563e-88f3-44d1-a295-ab74b4d59d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:44.336387 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4563e-88f3-44d1-a295-ab74b4d59d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:44.344830 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4563e-88f3-44d1-a295-ab74b4d59d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:44.346253 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4563e-88f3-44d1-a295-ab74b4d59d6b service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:44.355891 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1365/2753] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:18:52.014927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547bb6-870d-4c4f-81aa-118f8d321d0f None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:52.015439 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547bb6-870d-4c4f-81aa-118f8d321d0f None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:52.015558 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547bb6-870d-4c4f-81aa-118f8d321d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:52.034627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-0f547bb6-870d-4c4f-81aa-118f8d321d0f None None] MFA Rules not processed for user `a040f742005145a58f1d9f17d538ed24`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:52.035816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0f547bb6-870d-4c4f-81aa-118f8d321d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:52.091227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1389/2754] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:18:54.351097 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:54.360135 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4563e-88f3-44d1-a295-ab74b4d59d6b service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:54.422877 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4563e-88f3-44d1-a295-ab74b4d59d6b service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:54.427459 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:54.428093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:54.428383 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:54.428636 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] PATH_INFO: `/v3/users/0453a9d5bb63454bbf6b52e7602cef17` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:54.429792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0453a9d5bb63454bbf6b52e7602cef17)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:54.431725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:54.478598 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0453a9d5bb63454bbf6b52e7602cef17'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:54.479163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0453a9d5bb63454bbf6b52e7602cef17'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:54.486658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0453a9d5bb63454bbf6b52e7602cef17'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:54.500309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0453a9d5bb63454bbf6b52e7602cef17'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:54.501152 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0453a9d5bb63454bbf6b52e7602cef17'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:54.515335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1366/2755] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:18:54 2022] DELETE /identity/v3/users/0453a9d5bb63454bbf6b52e7602cef17 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:18:54.519868 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6342a5-5f3b-4bfc-9ae2-8789d7c645b6 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:54.520366 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6342a5-5f3b-4bfc-9ae2-8789d7c645b6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:54.520612 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6342a5-5f3b-4bfc-9ae2-8789d7c645b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:54.540296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-5d6342a5-5f3b-4bfc-9ae2-8789d7c645b6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:18:54.541586 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-5d6342a5-5f3b-4bfc-9ae2-8789d7c645b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:54.602513 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1390/2756] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:18:54.612309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:54.613742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:54.673753 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988674e9-4eb0-4844-b6c6-4a2a6206912f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:54.677397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c925f-8f75-4c8d-b00d-7ea5c8e6241d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:54.678007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c925f-8f75-4c8d-b00d-7ea5c8e6241d service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:54.678291 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c925f-8f75-4c8d-b00d-7ea5c8e6241d service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:54.678604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c925f-8f75-4c8d-b00d-7ea5c8e6241d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:54.689084 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c925f-8f75-4c8d-b00d-7ea5c8e6241d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:54.691972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c925f-8f75-4c8d-b00d-7ea5c8e6241d service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:54.704287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1367/2757] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:18:55.042637 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6342a5-5f3b-4bfc-9ae2-8789d7c645b6 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:18:55.044230 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-5d6342a5-5f3b-4bfc-9ae2-8789d7c645b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:18:55.057820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6342a5-5f3b-4bfc-9ae2-8789d7c645b6 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:18:55.063937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:18:55.064583 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:18:55.064859 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:18:55.065131 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] PATH_INFO: `/v3/projects/f4649e71f6354d89ba607c2d50e8fbb3` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:18:55.066300 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4649e71f6354d89ba607c2d50e8fbb3)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:18:55.068407 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:18:55.118035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4649e71f6354d89ba607c2d50e8fbb3', 'request_id': 'req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:55.125862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4649e71f6354d89ba607c2d50e8fbb3', 'request_id': 'req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:55.130614 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:55.133044 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4649e71f6354d89ba607c2d50e8fbb3', 'request_id': 'req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:55.147464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] The token cache is being invalidate because project f4649e71f6354d89ba607c2d50e8fbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:18:55.147752 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:55.148398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:18:55.149939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1391/2758] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:18:55 2022] DELETE /identity/v3/projects/f4649e71f6354d89ba607c2d50e8fbb3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:19:02.130917 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c925f-8f75-4c8d-b00d-7ea5c8e6241d service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:19:02.132326 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d73c925f-8f75-4c8d-b00d-7ea5c8e6241d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:19:02.144042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c925f-8f75-4c8d-b00d-7ea5c8e6241d service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:19:02.164206 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:02.201812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d470bda-c603-4493-a412-13d08551ee7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:19:02.202812 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470bda-c603-4493-a412-13d08551ee7d service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:19:02.203093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470bda-c603-4493-a412-13d08551ee7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:19:02.203366 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470bda-c603-4493-a412-13d08551ee7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:19:02.205143 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4d470bda-c603-4493-a412-13d08551ee7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:19:02.280621 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d470bda-c603-4493-a412-13d08551ee7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:19:02.282138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d470bda-c603-4493-a412-13d08551ee7d service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:19:02.293508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1368/2759] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:19:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:19:04.859463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:19:04.860917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:19:04.873792 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2d364-f56e-42e8-8f4b-92f8418bfe2b admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:19:04.877387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ce6b3-f64b-4fca-bea3-ab89c7021366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:19:04.877994 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ce6b3-f64b-4fca-bea3-ab89c7021366 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:19:04.878630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ce6b3-f64b-4fca-bea3-ab89c7021366 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:19:04.878630 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ce6b3-f64b-4fca-bea3-ab89c7021366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:19:04.880288 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d42ce6b3-f64b-4fca-bea3-ab89c7021366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:19:04.893713 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ce6b3-f64b-4fca-bea3-ab89c7021366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:19:04.895250 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ce6b3-f64b-4fca-bea3-ab89c7021366 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:19:04.908371 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1392/2760] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:19:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:19:12.288356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=44 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:14.609413 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee048f6-8370-465b-af8a-6ae5eac1cc92 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:19:14.609990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee048f6-8370-465b-af8a-6ae5eac1cc92 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:19:14.609990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee048f6-8370-465b-af8a-6ae5eac1cc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:19:14.658197 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0ee048f6-8370-465b-af8a-6ae5eac1cc92 None None] MFA Rules not processed for user `39169d922474437ebb7605d4a34dd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:19:14.659415 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0ee048f6-8370-465b-af8a-6ae5eac1cc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:19:14.722892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1369/2761] 10.222.0.36 () {58 vars in 967 bytes} [Thu Jul 28 02:19:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:19:14.768255 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ce6b3-f64b-4fca-bea3-ab89c7021366 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:19:14.769655 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d42ce6b3-f64b-4fca-bea3-ab89c7021366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:19:14.858009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ce6b3-f64b-4fca-bea3-ab89c7021366 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:19:14.863027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecd326-10e8-4da8-b9f4-1dfe9890adb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a891bb14f40d403b90915115bc487b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:19:14.863639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecd326-10e8-4da8-b9f4-1dfe9890adb4 service swift] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:19:14.863919 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecd326-10e8-4da8-b9f4-1dfe9890adb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:19:14.864196 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecd326-10e8-4da8-b9f4-1dfe9890adb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:19:14.872516 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecd326-10e8-4da8-b9f4-1dfe9890adb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:19:14.874102 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecd326-10e8-4da8-b9f4-1dfe9890adb4 service swift] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:19:14.882107 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1393/2762] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Jul 28 02:19:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 02:19:21.484799 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee048f6-8370-465b-af8a-6ae5eac1cc92 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:19:21.486405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0ee048f6-8370-465b-af8a-6ae5eac1cc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:19:21.553829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee048f6-8370-465b-af8a-6ae5eac1cc92 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:19:21.558535 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:19:21.568309 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:19:21.568637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:19:21.568925 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] PATH_INFO: `/v3/users/b412d6b9d787499a81c96b35375f0a40` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:19:21.570220 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b412d6b9d787499a81c96b35375f0a40)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:19:21.572199 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:19:21.618679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b412d6b9d787499a81c96b35375f0a40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:21.619343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b412d6b9d787499a81c96b35375f0a40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:21.626741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b412d6b9d787499a81c96b35375f0a40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:21.644829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b412d6b9d787499a81c96b35375f0a40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:21.645544 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b412d6b9d787499a81c96b35375f0a40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:21.647903 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:21.661771 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1370/2763] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:19:21 2022] DELETE /identity/v3/users/b412d6b9d787499a81c96b35375f0a40 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:19:21.834940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecd326-10e8-4da8-b9f4-1dfe9890adb4 service swift] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:19:21.845696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecd326-10e8-4da8-b9f4-1dfe9890adb4 service swift] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:19:21.902623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:19:21.903261 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:19:21.903544 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:19:21.903818 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] PATH_INFO: `/v3/projects/21307cc53580410e924842528e5fb5a5` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:19:21.904971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=21307cc53580410e924842528e5fb5a5)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:19:21.906957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:19:21.953072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:21.954526 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21307cc53580410e924842528e5fb5a5', 'request_id': 'req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:21.962123 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21307cc53580410e924842528e5fb5a5', 'request_id': 'req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:21.967862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21307cc53580410e924842528e5fb5a5', 'request_id': 'req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:21.978422 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] The token cache is being invalidate because project 21307cc53580410e924842528e5fb5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:19:21.978819 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:21.979440 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:21.980901 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1394/2764] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:19:21 2022] DELETE /identity/v3/projects/21307cc53580410e924842528e5fb5a5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:19:21.984955 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:19:21.986403 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:19:21.999950 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291031b-7ddc-405e-bf32-63d56c13dfca admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:19:22.055966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:19:22.056603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:19:22.056883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:19:22.057707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] PATH_INFO: `/v3/users/7c3b370a1dca4af1a7015d0d9c2bfb45` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:19:22.058929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3b370a1dca4af1a7015d0d9c2bfb45)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:19:22.060832 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:19:22.106885 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3b370a1dca4af1a7015d0d9c2bfb45'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:22.107469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3b370a1dca4af1a7015d0d9c2bfb45'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:22.114355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3b370a1dca4af1a7015d0d9c2bfb45'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:22.126840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3b370a1dca4af1a7015d0d9c2bfb45'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:22.127445 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3b370a1dca4af1a7015d0d9c2bfb45'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:22.139354 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1371/2765] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:19:21 2022] DELETE /identity/v3/users/7c3b370a1dca4af1a7015d0d9c2bfb45 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:19:22.311574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:19:22.313376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:19:22.326533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa36ce3-0563-4534-b56a-dc1b9a8dec0f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:19:22.383273 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:19:22.383857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:19:22.384132 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:19:22.384403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] PATH_INFO: `/v3/projects/78114fc677df4e58a07664f5f94c8519` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:19:22.385567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78114fc677df4e58a07664f5f94c8519)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:19:22.387539 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:19:22.430912 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78114fc677df4e58a07664f5f94c8519', 'request_id': 'req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:22.438926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78114fc677df4e58a07664f5f94c8519', 'request_id': 'req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:22.444306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78114fc677df4e58a07664f5f94c8519', 'request_id': 'req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:22.455387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] The token cache is being invalidate because project 78114fc677df4e58a07664f5f94c8519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:19:22.455667 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:22.456277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:19:22.457738 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1395/2766] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:19:22 2022] DELETE /identity/v3/projects/78114fc677df4e58a07664f5f94c8519 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:19:32.136023 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:32.452503 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:00.855117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:20:00.856577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:00.912807 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8889503-47b5-4303-89ed-24cb1b6193e9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:20:00.960048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debcdfc-0cfa-4cc9-bb99-719901581a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:20:00.960659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debcdfc-0cfa-4cc9-bb99-719901581a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:20:00.960938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debcdfc-0cfa-4cc9-bb99-719901581a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:20:00.961209 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debcdfc-0cfa-4cc9-bb99-719901581a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:20:00.962987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3debcdfc-0cfa-4cc9-bb99-719901581a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:00.972103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debcdfc-0cfa-4cc9-bb99-719901581a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:20:00.973509 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debcdfc-0cfa-4cc9-bb99-719901581a69 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:20:00.981398 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1372/2767] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:20:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:20:10.977848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=46 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:23.906858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:20:23.908459 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:24.021267 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2154b-c16a-4cd9-a46f-a8bda61e36c9 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:20:24.027449 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76fde1-8a52-47ca-8949-487cee0a6916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:20:24.028189 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76fde1-8a52-47ca-8949-487cee0a6916 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:20:24.028541 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76fde1-8a52-47ca-8949-487cee0a6916 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:20:24.028916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76fde1-8a52-47ca-8949-487cee0a6916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:20:24.030820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6e76fde1-8a52-47ca-8949-487cee0a6916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:24.046118 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76fde1-8a52-47ca-8949-487cee0a6916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:20:24.047879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76fde1-8a52-47ca-8949-487cee0a6916 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:20:24.075703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1396/2768] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:20:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:20:32.382079 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b50ae3-9c2a-4bab-865d-79bdc3e95b29 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:20:32.382617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b50ae3-9c2a-4bab-865d-79bdc3e95b29 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:20:32.382719 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b50ae3-9c2a-4bab-865d-79bdc3e95b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:20:32.401557 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a0b50ae3-9c2a-4bab-865d-79bdc3e95b29 None None] MFA Rules not processed for user `a040f742005145a58f1d9f17d538ed24`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:20:32.403436 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a0b50ae3-9c2a-4bab-865d-79bdc3e95b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:32.457037 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1373/2769] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:20:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:20:32.757595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76fde1-8a52-47ca-8949-487cee0a6916 service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:20:32.759027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-6e76fde1-8a52-47ca-8949-487cee0a6916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:32.770761 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76fde1-8a52-47ca-8949-487cee0a6916 service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:20:32.774222 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb45c17-6d65-40f0-a703-ee7f2dbf14f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:20:32.774845 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb45c17-6d65-40f0-a703-ee7f2dbf14f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:20:32.775120 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb45c17-6d65-40f0-a703-ee7f2dbf14f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:20:32.775389 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb45c17-6d65-40f0-a703-ee7f2dbf14f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:20:32.777078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9bb45c17-6d65-40f0-a703-ee7f2dbf14f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:32.786104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb45c17-6d65-40f0-a703-ee7f2dbf14f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:20:32.787575 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb45c17-6d65-40f0-a703-ee7f2dbf14f3 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:20:32.795463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1397/2770] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:20:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:20:33.114453 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b50ae3-9c2a-4bab-865d-79bdc3e95b29 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:20:33.115851 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a0b50ae3-9c2a-4bab-865d-79bdc3e95b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:33.191450 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b50ae3-9c2a-4bab-865d-79bdc3e95b29 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:20:33.196475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e205aa-7f74-4bf7-b26b-adcb7c244b16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:20:33.197093 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e205aa-7f74-4bf7-b26b-adcb7c244b16 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:20:33.197376 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e205aa-7f74-4bf7-b26b-adcb7c244b16 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:20:33.197648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e205aa-7f74-4bf7-b26b-adcb7c244b16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:20:33.199503 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e1e205aa-7f74-4bf7-b26b-adcb7c244b16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:33.210789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e205aa-7f74-4bf7-b26b-adcb7c244b16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:20:33.212349 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e205aa-7f74-4bf7-b26b-adcb7c244b16 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:20:33.222311 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1374/2771] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:20:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:20:42.713589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb45c17-6d65-40f0-a703-ee7f2dbf14f3 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:20:42.715073 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9bb45c17-6d65-40f0-a703-ee7f2dbf14f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:42.733664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb45c17-6d65-40f0-a703-ee7f2dbf14f3 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:20:42.739191 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed07ac-ba3c-4280-b6d8-97956a7e79da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:20:42.739801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed07ac-ba3c-4280-b6d8-97956a7e79da service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:20:42.740089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed07ac-ba3c-4280-b6d8-97956a7e79da service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:20:42.740363 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed07ac-ba3c-4280-b6d8-97956a7e79da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:20:42.742153 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-35ed07ac-ba3c-4280-b6d8-97956a7e79da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:20:42.755026 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed07ac-ba3c-4280-b6d8-97956a7e79da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:20:42.756609 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed07ac-ba3c-4280-b6d8-97956a7e79da service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:20:42.767342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1398/2772] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:20:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:20:43.218007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=57 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:52.762781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=46 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:12.417528 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01726068-1a96-4714-9f6a-c5be7c102d61 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:22:12.418068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01726068-1a96-4714-9f6a-c5be7c102d61 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:22:12.418068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01726068-1a96-4714-9f6a-c5be7c102d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:22:12.437520 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-01726068-1a96-4714-9f6a-c5be7c102d61 None None] MFA Rules not processed for user `a040f742005145a58f1d9f17d538ed24`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:22:12.438749 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-01726068-1a96-4714-9f6a-c5be7c102d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:22:12.445492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1375/2773] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:22:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:22:16.464023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed07ac-ba3c-4280-b6d8-97956a7e79da service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:22:16.475084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed07ac-ba3c-4280-b6d8-97956a7e79da service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:22:16.480986 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c620d2a-e123-44b4-8070-8d1567a21025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:22:16.481592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c620d2a-e123-44b4-8070-8d1567a21025 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:22:16.481866 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c620d2a-e123-44b4-8070-8d1567a21025 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:22:16.482148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c620d2a-e123-44b4-8070-8d1567a21025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:22:16.483885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4c620d2a-e123-44b4-8070-8d1567a21025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:22:16.493844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c620d2a-e123-44b4-8070-8d1567a21025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:22:16.495427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c620d2a-e123-44b4-8070-8d1567a21025 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:22:16.504689 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1399/2774] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:22:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:22:22.432079 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:26.500744 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=6 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:59.131496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01726068-1a96-4714-9f6a-c5be7c102d61 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:22:59.132915 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-01726068-1a96-4714-9f6a-c5be7c102d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:22:59.147457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01726068-1a96-4714-9f6a-c5be7c102d61 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:22:59.152829 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45555644-9e1c-4d71-8aad-e1565350d608 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:22:59.153428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45555644-9e1c-4d71-8aad-e1565350d608 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:22:59.153703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45555644-9e1c-4d71-8aad-e1565350d608 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:22:59.153972 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45555644-9e1c-4d71-8aad-e1565350d608 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:22:59.155667 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-45555644-9e1c-4d71-8aad-e1565350d608 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:22:59.166762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45555644-9e1c-4d71-8aad-e1565350d608 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:22:59.168993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45555644-9e1c-4d71-8aad-e1565350d608 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:22:59.178728 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1376/2775] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:22:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:23:09.174633 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:53.346392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c620d2a-e123-44b4-8070-8d1567a21025 service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:53.355639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c620d2a-e123-44b4-8070-8d1567a21025 service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:53.359224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bf9d9-b538-4101-a918-e68e097f5fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:53.359816 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf9d9-b538-4101-a918-e68e097f5fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:53.360094 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf9d9-b538-4101-a918-e68e097f5fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:53.360365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf9d9-b538-4101-a918-e68e097f5fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:53.362098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7e8bf9d9-b538-4101-a918-e68e097f5fe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:23:53.423337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bf9d9-b538-4101-a918-e68e097f5fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:53.424764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bf9d9-b538-4101-a918-e68e097f5fe9 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:53.434216 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1400/2776] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:23:56.495080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45555644-9e1c-4d71-8aad-e1565350d608 service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:56.529237 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45555644-9e1c-4d71-8aad-e1565350d608 service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:56.545062 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496e1c-5ff8-4e3f-904d-a265500ffdee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:56.546110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496e1c-5ff8-4e3f-904d-a265500ffdee service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:56.546762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496e1c-5ff8-4e3f-904d-a265500ffdee service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:56.547163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496e1c-5ff8-4e3f-904d-a265500ffdee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:56.550166 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-98496e1c-5ff8-4e3f-904d-a265500ffdee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:23:56.563399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496e1c-5ff8-4e3f-904d-a265500ffdee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:56.567542 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496e1c-5ff8-4e3f-904d-a265500ffdee service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:56.568688 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bf9d9-b538-4101-a918-e68e097f5fe9 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:56.570156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7e8bf9d9-b538-4101-a918-e68e097f5fe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:23:56.578127 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1377/2777] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:23:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:23:56.583620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bf9d9-b538-4101-a918-e68e097f5fe9 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:56.589834 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:56.590588 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:56.591018 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:56.591293 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] PATH_INFO: `/v3/users/a040f742005145a58f1d9f17d538ed24` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:56.592485 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a040f742005145a58f1d9f17d538ed24)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:56.594995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:56.642171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a040f742005145a58f1d9f17d538ed24'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:23:56.642878 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a040f742005145a58f1d9f17d538ed24'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:23:56.649926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a040f742005145a58f1d9f17d538ed24'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:23:56.662563 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a040f742005145a58f1d9f17d538ed24'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:23:56.663208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9fee7f83-a810-470d-914a-5066504a5101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a040f742005145a58f1d9f17d538ed24'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:23:56.675920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1401/2778] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:23:56 2022] DELETE /identity/v3/users/a040f742005145a58f1d9f17d538ed24 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:23:56.850699 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496e1c-5ff8-4e3f-904d-a265500ffdee service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:56.861242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496e1c-5ff8-4e3f-904d-a265500ffdee service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:56.917752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:56.918421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:56.918713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:56.918983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] PATH_INFO: `/v3/projects/8b203a6c14664b26bb9c2ce6bf52e6d6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:56.920124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b203a6c14664b26bb9c2ce6bf52e6d6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:56.921987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:56.967696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b203a6c14664b26bb9c2ce6bf52e6d6', 'request_id': 'req-06519fab-8be1-47bd-837b-23e8696cfb22'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:23:56.973661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b203a6c14664b26bb9c2ce6bf52e6d6', 'request_id': 'req-06519fab-8be1-47bd-837b-23e8696cfb22'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:23:56.979628 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b203a6c14664b26bb9c2ce6bf52e6d6', 'request_id': 'req-06519fab-8be1-47bd-837b-23e8696cfb22'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:23:56.991607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] The token cache is being invalidate because project 8b203a6c14664b26bb9c2ce6bf52e6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:23:56.991890 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:23:56.992498 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06519fab-8be1-47bd-837b-23e8696cfb22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:23:56.993993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1378/2779] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:23:56 2022] DELETE /identity/v3/projects/8b203a6c14664b26bb9c2ce6bf52e6d6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:23:56.998904 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c63e9b-96cc-4766-b5c8-49afb41a5433 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:56.999192 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c63e9b-96cc-4766-b5c8-49afb41a5433 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:56.999463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c63e9b-96cc-4766-b5c8-49afb41a5433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.018957 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-e7c63e9b-96cc-4766-b5c8-49afb41a5433 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:23:57.020137 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-e7c63e9b-96cc-4766-b5c8-49afb41a5433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:23:57.076593 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1402/2780] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:23:57.084778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a859c-c9f3-4c87-b9b0-95a09c805ed8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.085066 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a859c-c9f3-4c87-b9b0-95a09c805ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.085346 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a859c-c9f3-4c87-b9b0-95a09c805ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.105088 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-751a859c-c9f3-4c87-b9b0-95a09c805ed8 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:23:57.106287 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-751a859c-c9f3-4c87-b9b0-95a09c805ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:23:57.114231 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1379/2781] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:23:57.118183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c63e9b-96cc-4766-b5c8-49afb41a5433 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.128129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c63e9b-96cc-4766-b5c8-49afb41a5433 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.132719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b894f0-1482-4724-b012-97a0808c6222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.133314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b894f0-1482-4724-b012-97a0808c6222 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.133589 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b894f0-1482-4724-b012-97a0808c6222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.133857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b894f0-1482-4724-b012-97a0808c6222 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.134581 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b894f0-1482-4724-b012-97a0808c6222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:23:57.134885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b894f0-1482-4724-b012-97a0808c6222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.136468 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b894f0-1482-4724-b012-97a0808c6222 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.137893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:57.150323 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1403/2782] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:23:57.154222 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a859c-c9f3-4c87-b9b0-95a09c805ed8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.163692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a859c-c9f3-4c87-b9b0-95a09c805ed8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.168353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57c27f-9d41-47ab-a684-6c81374ce790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.168949 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57c27f-9d41-47ab-a684-6c81374ce790 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.169225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57c27f-9d41-47ab-a684-6c81374ce790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.169495 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57c27f-9d41-47ab-a684-6c81374ce790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.170154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57c27f-9d41-47ab-a684-6c81374ce790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.172125 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57c27f-9d41-47ab-a684-6c81374ce790 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.208379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1380/2783] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:23:57 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:23:57.212595 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b894f0-1482-4724-b012-97a0808c6222 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.222719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b894f0-1482-4724-b012-97a0808c6222 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.278579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7ea8-a849-4c22-9041-fba01f8a35ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.279185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7ea8-a849-4c22-9041-fba01f8a35ca admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.279464 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7ea8-a849-4c22-9041-fba01f8a35ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.279734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7ea8-a849-4c22-9041-fba01f8a35ca admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.280387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7ea8-a849-4c22-9041-fba01f8a35ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.282298 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7ea8-a849-4c22-9041-fba01f8a35ca admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.302573 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1404/2784] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:23:57 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:23:57.306716 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57c27f-9d41-47ab-a684-6c81374ce790 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.317690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57c27f-9d41-47ab-a684-6c81374ce790 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.322259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29551d-cc26-4e00-8260-89b07a14116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.322906 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29551d-cc26-4e00-8260-89b07a14116b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.323183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29551d-cc26-4e00-8260-89b07a14116b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.323454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29551d-cc26-4e00-8260-89b07a14116b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.324146 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29551d-cc26-4e00-8260-89b07a14116b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.325725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29551d-cc26-4e00-8260-89b07a14116b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.336087 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1381/2785] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:23:57.339784 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7ea8-a849-4c22-9041-fba01f8a35ca admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.349621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7ea8-a849-4c22-9041-fba01f8a35ca admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.354190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6859f96-0aa3-43ea-81d6-7321d164f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.354815 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6859f96-0aa3-43ea-81d6-7321d164f757 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.355117 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6859f96-0aa3-43ea-81d6-7321d164f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.355388 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6859f96-0aa3-43ea-81d6-7321d164f757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.356076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6859f96-0aa3-43ea-81d6-7321d164f757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.357641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6859f96-0aa3-43ea-81d6-7321d164f757 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.367937 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1405/2786] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:23:57.371772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29551d-cc26-4e00-8260-89b07a14116b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.381830 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29551d-cc26-4e00-8260-89b07a14116b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.386340 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81330011-1388-45f6-b62f-eb687569ae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.387018 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81330011-1388-45f6-b62f-eb687569ae5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.387292 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81330011-1388-45f6-b62f-eb687569ae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.387566 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81330011-1388-45f6-b62f-eb687569ae5d admin admin] PATH_INFO: `/v3/projects/4a0fcc9ac48e4b4ab542ba008701ec4f/users/24e1919ba45b468c9113aee6d6e3a17e/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.403582 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81330011-1388-45f6-b62f-eb687569ae5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0fcc9ac48e4b4ab542ba008701ec4f, user_id=24e1919ba45b468c9113aee6d6e3a17e, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.406210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81330011-1388-45f6-b62f-eb687569ae5d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.418821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1382/2787] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:23:57 2022] PUT /identity/v3/projects/4a0fcc9ac48e4b4ab542ba008701ec4f/users/24e1919ba45b468c9113aee6d6e3a17e/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:23:57.429996 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af0757-891b-46ab-8f0e-8192f6c31279 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.430280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af0757-891b-46ab-8f0e-8192f6c31279 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.430574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af0757-891b-46ab-8f0e-8192f6c31279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.458706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-70af0757-891b-46ab-8f0e-8192f6c31279 None None] MFA Rules not processed for user `24e1919ba45b468c9113aee6d6e3a17e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:23:57.459915 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-70af0757-891b-46ab-8f0e-8192f6c31279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:23:57.522873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1406/2788] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:23:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:23:57.527407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81330011-1388-45f6-b62f-eb687569ae5d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.533787 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:57.591756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81330011-1388-45f6-b62f-eb687569ae5d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.600795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a439bb-669b-4b89-a6fb-cb064186326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.601554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a439bb-669b-4b89-a6fb-cb064186326d admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.601821 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a439bb-669b-4b89-a6fb-cb064186326d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.602168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a439bb-669b-4b89-a6fb-cb064186326d admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.602782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a439bb-669b-4b89-a6fb-cb064186326d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.605802 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a439bb-669b-4b89-a6fb-cb064186326d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.635177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1383/2789] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:23:57 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:23:57.639179 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af0757-891b-46ab-8f0e-8192f6c31279 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.650091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af0757-891b-46ab-8f0e-8192f6c31279 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.708636 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ac74b-6888-40e1-8fd4-444b640e6614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.709375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ac74b-6888-40e1-8fd4-444b640e6614 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.709717 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ac74b-6888-40e1-8fd4-444b640e6614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.710053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ac74b-6888-40e1-8fd4-444b640e6614 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.710812 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ac74b-6888-40e1-8fd4-444b640e6614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.712720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ac74b-6888-40e1-8fd4-444b640e6614 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.721484 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:57.736224 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1407/2790] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:23:57 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:23:57.740160 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a439bb-669b-4b89-a6fb-cb064186326d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.752074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a439bb-669b-4b89-a6fb-cb064186326d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.756929 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779e827-1e34-4f6c-a326-bce7681fe883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.757575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779e827-1e34-4f6c-a326-bce7681fe883 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.757858 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779e827-1e34-4f6c-a326-bce7681fe883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.758136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779e827-1e34-4f6c-a326-bce7681fe883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.758871 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779e827-1e34-4f6c-a326-bce7681fe883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.760465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779e827-1e34-4f6c-a326-bce7681fe883 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.772351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1384/2791] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:23:57.776592 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ac74b-6888-40e1-8fd4-444b640e6614 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.786932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ac74b-6888-40e1-8fd4-444b640e6614 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.791675 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0332c91-17e7-4f4b-b587-6f38da15f7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.792327 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332c91-17e7-4f4b-b587-6f38da15f7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.792608 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332c91-17e7-4f4b-b587-6f38da15f7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.792881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332c91-17e7-4f4b-b587-6f38da15f7c7 admin admin] PATH_INFO: `/v3/projects/3aa24565226546ed84024d67ecbbc8d4/users/b94c1b77db8c482ab9c7ca1ea89277c2/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.807973 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0332c91-17e7-4f4b-b587-6f38da15f7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa24565226546ed84024d67ecbbc8d4, user_id=b94c1b77db8c482ab9c7ca1ea89277c2, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.810662 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0332c91-17e7-4f4b-b587-6f38da15f7c7 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.824219 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1408/2792] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:23:57 2022] PUT /identity/v3/projects/3aa24565226546ed84024d67ecbbc8d4/users/b94c1b77db8c482ab9c7ca1ea89277c2/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:23:57.828279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779e827-1e34-4f6c-a326-bce7681fe883 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.838715 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779e827-1e34-4f6c-a326-bce7681fe883 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.896968 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7954ef-8d80-4dae-b7c5-de0fa9393ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.897532 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7954ef-8d80-4dae-b7c5-de0fa9393ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.897810 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7954ef-8d80-4dae-b7c5-de0fa9393ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.898080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7954ef-8d80-4dae-b7c5-de0fa9393ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.898805 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7954ef-8d80-4dae-b7c5-de0fa9393ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.900435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7954ef-8d80-4dae-b7c5-de0fa9393ddc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.910707 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1385/2793] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:23:57.914974 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0332c91-17e7-4f4b-b587-6f38da15f7c7 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:57.925803 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0332c91-17e7-4f4b-b587-6f38da15f7c7 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:57.930370 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed1e2e-5685-4f8e-bc17-963501787949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:57.931047 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1e2e-5685-4f8e-bc17-963501787949 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.931331 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1e2e-5685-4f8e-bc17-963501787949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.931606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1e2e-5685-4f8e-bc17-963501787949 admin admin] PATH_INFO: `/v3/projects/3aa24565226546ed84024d67ecbbc8d4/users/b94c1b77db8c482ab9c7ca1ea89277c2/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.933553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed1e2e-5685-4f8e-bc17-963501787949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa24565226546ed84024d67ecbbc8d4, user_id=b94c1b77db8c482ab9c7ca1ea89277c2, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:57.936509 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed1e2e-5685-4f8e-bc17-963501787949 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:57.946487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1409/2794] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:23:57 2022] PUT /identity/v3/projects/3aa24565226546ed84024d67ecbbc8d4/users/b94c1b77db8c482ab9c7ca1ea89277c2/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:23:57.956655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9610-547f-44b2-9968-36befb783b0a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:57.956948 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9610-547f-44b2-9968-36befb783b0a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:57.957836 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9610-547f-44b2-9968-36befb783b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:57.990990 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e0ae9610-547f-44b2-9968-36befb783b0a None None] MFA Rules not processed for user `b94c1b77db8c482ab9c7ca1ea89277c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:23:57.992276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e0ae9610-547f-44b2-9968-36befb783b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:23:58.056684 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:58.061352 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1386/2795] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:23:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:23:58.074846 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed1e2e-5685-4f8e-bc17-963501787949 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:58.076566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-98ed1e2e-5685-4f8e-bc17-963501787949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:23:58.134112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed1e2e-5685-4f8e-bc17-963501787949 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:58.137752 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba2b58-6f06-4bec-97e9-f56c723f7fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:58.138353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2b58-6f06-4bec-97e9-f56c723f7fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:58.138730 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2b58-6f06-4bec-97e9-f56c723f7fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:58.139005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2b58-6f06-4bec-97e9-f56c723f7fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:58.148038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba2b58-6f06-4bec-97e9-f56c723f7fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:58.149410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba2b58-6f06-4bec-97e9-f56c723f7fb5 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:58.159281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1410/2796] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:23:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:23:58.234570 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae9610-547f-44b2-9968-36befb783b0a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:23:58.244736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae9610-547f-44b2-9968-36befb783b0a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:23:58.248351 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3dd25-b794-45b5-8f38-f29bb667cc41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:23:58.248953 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3dd25-b794-45b5-8f38-f29bb667cc41 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:23:58.249233 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3dd25-b794-45b5-8f38-f29bb667cc41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:23:58.249505 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3dd25-b794-45b5-8f38-f29bb667cc41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:23:58.308834 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3dd25-b794-45b5-8f38-f29bb667cc41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:23:58.310272 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3dd25-b794-45b5-8f38-f29bb667cc41 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:23:58.319293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1387/2797] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:23:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:08.154844 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:08.315281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=28 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:27.219412 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba2b58-6f06-4bec-97e9-f56c723f7fb5 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:27.282151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba2b58-6f06-4bec-97e9-f56c723f7fb5 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:27.287881 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:27.288693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:27.289129 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:27.289413 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] PATH_INFO: `/v3/users/24e1919ba45b468c9113aee6d6e3a17e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:27.290639 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e1919ba45b468c9113aee6d6e3a17e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:27.293403 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:27.342057 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e1919ba45b468c9113aee6d6e3a17e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:27.342769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e1919ba45b468c9113aee6d6e3a17e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:27.350406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e1919ba45b468c9113aee6d6e3a17e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:27.363532 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e1919ba45b468c9113aee6d6e3a17e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:27.364745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e1919ba45b468c9113aee6d6e3a17e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:27.376691 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1411/2798] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:24:27 2022] DELETE /identity/v3/users/24e1919ba45b468c9113aee6d6e3a17e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:27.381769 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237502c-fc91-4062-b4f2-8a1cdb78a28d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:27.382279 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237502c-fc91-4062-b4f2-8a1cdb78a28d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:27.382386 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237502c-fc91-4062-b4f2-8a1cdb78a28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:27.400602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4237502c-fc91-4062-b4f2-8a1cdb78a28d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:27.401784 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4237502c-fc91-4062-b4f2-8a1cdb78a28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:27.458574 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1388/2799] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:27.468235 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:27.469685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:27.526333 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c53e4-fb9b-4260-9adc-bbb600eda251 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:27.530013 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c984294-506a-4f06-998a-bc3040b68d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:27.530651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c984294-506a-4f06-998a-bc3040b68d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:27.530935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c984294-506a-4f06-998a-bc3040b68d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:27.531212 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c984294-506a-4f06-998a-bc3040b68d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:27.540345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c984294-506a-4f06-998a-bc3040b68d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:27.541780 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c984294-506a-4f06-998a-bc3040b68d3f service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:27.552934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1412/2800] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 02:24:27.815317 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237502c-fc91-4062-b4f2-8a1cdb78a28d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:27.816878 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4237502c-fc91-4062-b4f2-8a1cdb78a28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:27.833476 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237502c-fc91-4062-b4f2-8a1cdb78a28d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:27.838268 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:27.838935 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:27.839210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:27.839484 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] PATH_INFO: `/v3/projects/4a0fcc9ac48e4b4ab542ba008701ec4f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:27.840632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0fcc9ac48e4b4ab542ba008701ec4f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:27.842559 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:27.892762 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0fcc9ac48e4b4ab542ba008701ec4f', 'request_id': 'req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:27.898914 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0fcc9ac48e4b4ab542ba008701ec4f', 'request_id': 'req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:27.905335 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0fcc9ac48e4b4ab542ba008701ec4f', 'request_id': 'req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:27.918349 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] The token cache is being invalidate because project 4a0fcc9ac48e4b4ab542ba008701ec4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:24:27.918867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:27.919494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:27.921042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1389/2801] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:24:27 2022] DELETE /identity/v3/projects/4a0fcc9ac48e4b4ab542ba008701ec4f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:27.925074 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c984294-506a-4f06-998a-bc3040b68d3f service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:27.937353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c984294-506a-4f06-998a-bc3040b68d3f service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:27.955622 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:27.995405 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:27.996023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:27.996299 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:27.996576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] PATH_INFO: `/v3/users/b94c1b77db8c482ab9c7ca1ea89277c2` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:27.997710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94c1b77db8c482ab9c7ca1ea89277c2)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:27.999663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:28.046195 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94c1b77db8c482ab9c7ca1ea89277c2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:28.046861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94c1b77db8c482ab9c7ca1ea89277c2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:28.054229 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94c1b77db8c482ab9c7ca1ea89277c2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:28.066504 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94c1b77db8c482ab9c7ca1ea89277c2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:28.067154 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-20b6c95d-4827-43eb-b45b-b60573f4cf57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94c1b77db8c482ab9c7ca1ea89277c2'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:28.080494 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1413/2802] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:24:27 2022] DELETE /identity/v3/users/b94c1b77db8c482ab9c7ca1ea89277c2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:28.354690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:28.356154 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:28.369612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1573e3-8dbc-4482-97d7-d72f72ba6de3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:28.427010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:28.427752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:28.427905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:28.428227 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] PATH_INFO: `/v3/projects/3aa24565226546ed84024d67ecbbc8d4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:28.429323 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa24565226546ed84024d67ecbbc8d4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:28.431258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:28.461504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:28.479293 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa24565226546ed84024d67ecbbc8d4', 'request_id': 'req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:28.484778 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa24565226546ed84024d67ecbbc8d4', 'request_id': 'req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:28.491310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa24565226546ed84024d67ecbbc8d4', 'request_id': 'req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:28.503487 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] The token cache is being invalidate because project 3aa24565226546ed84024d67ecbbc8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:24:28.503773 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:28.504391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bf93d0e2-20cc-48ac-84cb-8f422c4f3425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:28.506417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1390/2803] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:24:28 2022] DELETE /identity/v3/projects/3aa24565226546ed84024d67ecbbc8d4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:28.511324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4412-238c-4ac3-9bc9-d1191d157ef5 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:28.511777 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4412-238c-4ac3-9bc9-d1191d157ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:28.511893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4412-238c-4ac3-9bc9-d1191d157ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:28.531354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-127b4412-238c-4ac3-9bc9-d1191d157ef5 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:28.532564 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-127b4412-238c-4ac3-9bc9-d1191d157ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:28.591139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1414/2804] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:28.602059 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bcff6-ebd7-43e8-acf4-d66886973871 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:28.602345 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bcff6-ebd7-43e8-acf4-d66886973871 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:28.602647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bcff6-ebd7-43e8-acf4-d66886973871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:28.623970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c21bcff6-ebd7-43e8-acf4-d66886973871 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:28.625175 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c21bcff6-ebd7-43e8-acf4-d66886973871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:28.633184 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1391/2805] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:28.637601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4412-238c-4ac3-9bc9-d1191d157ef5 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:28.647548 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4412-238c-4ac3-9bc9-d1191d157ef5 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:28.652240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94dadd-9cce-46b2-b631-c3f22c883b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:28.652847 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94dadd-9cce-46b2-b631-c3f22c883b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:28.653130 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94dadd-9cce-46b2-b631-c3f22c883b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:28.653414 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94dadd-9cce-46b2-b631-c3f22c883b01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:28.654146 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94dadd-9cce-46b2-b631-c3f22c883b01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:24:28.654470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94dadd-9cce-46b2-b631-c3f22c883b01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:28.656084 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94dadd-9cce-46b2-b631-c3f22c883b01 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:28.667959 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1415/2806] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:24:28.672122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bcff6-ebd7-43e8-acf4-d66886973871 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:28.681862 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bcff6-ebd7-43e8-acf4-d66886973871 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:28.686789 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3514cd-fa82-4ad9-a15e-56917faef3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:28.687380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3514cd-fa82-4ad9-a15e-56917faef3ce admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:28.687671 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3514cd-fa82-4ad9-a15e-56917faef3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:28.687922 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3514cd-fa82-4ad9-a15e-56917faef3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:28.688583 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3514cd-fa82-4ad9-a15e-56917faef3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:28.690463 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3514cd-fa82-4ad9-a15e-56917faef3ce admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:28.717701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1392/2807] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:24:28 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:28.721775 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94dadd-9cce-46b2-b631-c3f22c883b01 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:28.731720 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94dadd-9cce-46b2-b631-c3f22c883b01 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:28.757369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:28.788533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adb2e1-0c1b-4a65-89be-cfda808ea9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:28.789139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb2e1-0c1b-4a65-89be-cfda808ea9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:28.789450 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb2e1-0c1b-4a65-89be-cfda808ea9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:28.789727 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb2e1-0c1b-4a65-89be-cfda808ea9a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:28.790392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adb2e1-0c1b-4a65-89be-cfda808ea9a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:28.792354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adb2e1-0c1b-4a65-89be-cfda808ea9a0 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:28.813038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1416/2808] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:24:28 2022] POST /identity/v3/users => generated 278 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:28.817722 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3514cd-fa82-4ad9-a15e-56917faef3ce admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:28.828035 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3514cd-fa82-4ad9-a15e-56917faef3ce admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:28.833245 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e019fc-6d41-4ee0-a25a-6c451103423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:28.833854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e019fc-6d41-4ee0-a25a-6c451103423b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:28.834134 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e019fc-6d41-4ee0-a25a-6c451103423b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:28.834405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e019fc-6d41-4ee0-a25a-6c451103423b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:28.835138 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e019fc-6d41-4ee0-a25a-6c451103423b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:28.836732 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e019fc-6d41-4ee0-a25a-6c451103423b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:28.846983 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1393/2809] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:28.850798 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adb2e1-0c1b-4a65-89be-cfda808ea9a0 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:28.860753 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adb2e1-0c1b-4a65-89be-cfda808ea9a0 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:28.865909 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e10db-9bde-4de1-8ddb-00de9baf6807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:28.866535 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e10db-9bde-4de1-8ddb-00de9baf6807 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:28.866820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e10db-9bde-4de1-8ddb-00de9baf6807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:28.867096 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e10db-9bde-4de1-8ddb-00de9baf6807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:28.867799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e10db-9bde-4de1-8ddb-00de9baf6807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:28.869398 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e10db-9bde-4de1-8ddb-00de9baf6807 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:28.881576 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1417/2810] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:28.885659 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e019fc-6d41-4ee0-a25a-6c451103423b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:28.895612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e019fc-6d41-4ee0-a25a-6c451103423b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:28.900191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d3b45-68ed-4f77-a88d-849322532c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:28.900842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d3b45-68ed-4f77-a88d-849322532c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:28.901119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d3b45-68ed-4f77-a88d-849322532c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:28.901393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d3b45-68ed-4f77-a88d-849322532c8d admin admin] PATH_INFO: `/v3/projects/126c1c48d90f4a759276ded94e49d715/users/06ddda7fc6b74837a104f8cac15b9cb0/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:28.915585 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d3b45-68ed-4f77-a88d-849322532c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=126c1c48d90f4a759276ded94e49d715, user_id=06ddda7fc6b74837a104f8cac15b9cb0, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:28.918208 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d3b45-68ed-4f77-a88d-849322532c8d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:28.931486 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1394/2811] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:28 2022] PUT /identity/v3/projects/126c1c48d90f4a759276ded94e49d715/users/06ddda7fc6b74837a104f8cac15b9cb0/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:28.941893 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ddcd-b4d8-46b9-a774-963b887f22e6 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:28.942205 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ddcd-b4d8-46b9-a774-963b887f22e6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:28.943020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ddcd-b4d8-46b9-a774-963b887f22e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:28.970862 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-eb14ddcd-b4d8-46b9-a774-963b887f22e6 None None] MFA Rules not processed for user `06ddda7fc6b74837a104f8cac15b9cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:28.972076 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-eb14ddcd-b4d8-46b9-a774-963b887f22e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:29.035148 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1418/2812] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:28 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:29.040349 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d3b45-68ed-4f77-a88d-849322532c8d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:29.101399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d3b45-68ed-4f77-a88d-849322532c8d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:29.105928 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f26aca-dc1b-4449-95fc-58fedf34a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:29.106566 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f26aca-dc1b-4449-95fc-58fedf34a932 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:29.106842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f26aca-dc1b-4449-95fc-58fedf34a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:29.107110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f26aca-dc1b-4449-95fc-58fedf34a932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:29.107782 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f26aca-dc1b-4449-95fc-58fedf34a932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:29.109643 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f26aca-dc1b-4449-95fc-58fedf34a932 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:29.135068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1395/2813] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:24:29 2022] POST /identity/v3/projects => generated 351 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:29.139072 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ddcd-b4d8-46b9-a774-963b887f22e6 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:29.150004 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ddcd-b4d8-46b9-a774-963b887f22e6 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:29.204296 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d98333-e5b2-4707-bb38-cbcca06252a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:29.204829 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d98333-e5b2-4707-bb38-cbcca06252a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:29.205105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d98333-e5b2-4707-bb38-cbcca06252a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:29.205375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d98333-e5b2-4707-bb38-cbcca06252a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:29.206033 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d98333-e5b2-4707-bb38-cbcca06252a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:29.208480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d98333-e5b2-4707-bb38-cbcca06252a4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:29.229477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1419/2814] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:24:29 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:24:29.233508 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f26aca-dc1b-4449-95fc-58fedf34a932 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:29.243648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f26aca-dc1b-4449-95fc-58fedf34a932 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:29.248156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6764-cc6e-40c3-82a1-4af32c22500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:29.248781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6764-cc6e-40c3-82a1-4af32c22500a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:29.249056 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6764-cc6e-40c3-82a1-4af32c22500a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:29.249325 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6764-cc6e-40c3-82a1-4af32c22500a admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:29.250010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a6764-cc6e-40c3-82a1-4af32c22500a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:29.251629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a6764-cc6e-40c3-82a1-4af32c22500a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:29.262584 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1396/2815] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:29.266835 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d98333-e5b2-4707-bb38-cbcca06252a4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:29.278480 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d98333-e5b2-4707-bb38-cbcca06252a4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:29.284869 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04e7d5-acf3-4a50-9e0e-a11b6bbd6008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:29.285745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04e7d5-acf3-4a50-9e0e-a11b6bbd6008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:29.286029 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04e7d5-acf3-4a50-9e0e-a11b6bbd6008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:29.286306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04e7d5-acf3-4a50-9e0e-a11b6bbd6008 admin admin] PATH_INFO: `/v3/projects/e0286520513047fb9de74670fd8f5ac6/users/46cfa9db9f3241ffbfa3f71e24b0f9b7/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:29.301020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04e7d5-acf3-4a50-9e0e-a11b6bbd6008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0286520513047fb9de74670fd8f5ac6, user_id=46cfa9db9f3241ffbfa3f71e24b0f9b7, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:29.303743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04e7d5-acf3-4a50-9e0e-a11b6bbd6008 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:29.316774 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1420/2816] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:29 2022] PUT /identity/v3/projects/e0286520513047fb9de74670fd8f5ac6/users/46cfa9db9f3241ffbfa3f71e24b0f9b7/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:29.321551 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6764-cc6e-40c3-82a1-4af32c22500a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:29.331248 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6764-cc6e-40c3-82a1-4af32c22500a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:29.351692 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:29.388925 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d886e74-d954-420a-a65b-e0e5bc29e3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:29.389625 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d886e74-d954-420a-a65b-e0e5bc29e3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:29.389905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d886e74-d954-420a-a65b-e0e5bc29e3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:29.390171 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d886e74-d954-420a-a65b-e0e5bc29e3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:29.391085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d886e74-d954-420a-a65b-e0e5bc29e3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:29.392648 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d886e74-d954-420a-a65b-e0e5bc29e3a3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:29.402156 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1397/2817] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:29.406256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04e7d5-acf3-4a50-9e0e-a11b6bbd6008 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:29.412220 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:29.418572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04e7d5-acf3-4a50-9e0e-a11b6bbd6008 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:29.423465 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444b2a4-9aa6-41c2-a59e-386f6b39a039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:29.424124 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b2a4-9aa6-41c2-a59e-386f6b39a039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:29.424404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b2a4-9aa6-41c2-a59e-386f6b39a039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:29.424674 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b2a4-9aa6-41c2-a59e-386f6b39a039 admin admin] PATH_INFO: `/v3/projects/e0286520513047fb9de74670fd8f5ac6/users/46cfa9db9f3241ffbfa3f71e24b0f9b7/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:29.427326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444b2a4-9aa6-41c2-a59e-386f6b39a039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0286520513047fb9de74670fd8f5ac6, user_id=46cfa9db9f3241ffbfa3f71e24b0f9b7, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:29.430012 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444b2a4-9aa6-41c2-a59e-386f6b39a039 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:29.440230 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1421/2818] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:29 2022] PUT /identity/v3/projects/e0286520513047fb9de74670fd8f5ac6/users/46cfa9db9f3241ffbfa3f71e24b0f9b7/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:29.450182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86469c5-5751-41cb-8189-21a0ab02b2c5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:29.450700 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86469c5-5751-41cb-8189-21a0ab02b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:29.450811 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86469c5-5751-41cb-8189-21a0ab02b2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:29.478031 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f86469c5-5751-41cb-8189-21a0ab02b2c5 None None] MFA Rules not processed for user `46cfa9db9f3241ffbfa3f71e24b0f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:29.479183 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f86469c5-5751-41cb-8189-21a0ab02b2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:29.545968 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1398/2819] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:29 2022] POST /identity/v3/auth/tokens => generated 3285 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:29.557890 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444b2a4-9aa6-41c2-a59e-386f6b39a039 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:29.559663 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2444b2a4-9aa6-41c2-a59e-386f6b39a039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:29.617948 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444b2a4-9aa6-41c2-a59e-386f6b39a039 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:29.621644 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138d07a-eadc-4fb5-8a3d-8600159d0597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:29.622253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138d07a-eadc-4fb5-8a3d-8600159d0597 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:29.622577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138d07a-eadc-4fb5-8a3d-8600159d0597 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:29.622854 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138d07a-eadc-4fb5-8a3d-8600159d0597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:29.632376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138d07a-eadc-4fb5-8a3d-8600159d0597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:29.633801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138d07a-eadc-4fb5-8a3d-8600159d0597 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:29.643134 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1422/2820] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:29 2022] GET /identity/v3/auth/tokens => generated 3285 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:29.718578 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86469c5-5751-41cb-8189-21a0ab02b2c5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:29.728590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86469c5-5751-41cb-8189-21a0ab02b2c5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:29.732202 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb892c9b-f6f1-4452-b194-3558823d0eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:29.732813 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb892c9b-f6f1-4452-b194-3558823d0eda service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:29.733092 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb892c9b-f6f1-4452-b194-3558823d0eda service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:29.733363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb892c9b-f6f1-4452-b194-3558823d0eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:29.788409 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb892c9b-f6f1-4452-b194-3558823d0eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:29.789837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb892c9b-f6f1-4452-b194-3558823d0eda service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:29.798682 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1399/2821] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:29 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:39.639049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:39.794685 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=80 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:44.575954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138d07a-eadc-4fb5-8a3d-8600159d0597 service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:44.637053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138d07a-eadc-4fb5-8a3d-8600159d0597 service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:44.641715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:44.642346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:44.642657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:44.642932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] PATH_INFO: `/v3/users/06ddda7fc6b74837a104f8cac15b9cb0` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:44.644127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ddda7fc6b74837a104f8cac15b9cb0)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:44.646253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:44.694664 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ddda7fc6b74837a104f8cac15b9cb0'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:44.695359 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ddda7fc6b74837a104f8cac15b9cb0'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:44.702319 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ddda7fc6b74837a104f8cac15b9cb0'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:44.714325 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ddda7fc6b74837a104f8cac15b9cb0'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:44.715001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ddda7fc6b74837a104f8cac15b9cb0'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:44.727068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1423/2822] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:24:44 2022] DELETE /identity/v3/users/06ddda7fc6b74837a104f8cac15b9cb0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:44.731554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27672c-cfd3-4b1b-bd48-ebab7bfffdf5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:44.732006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27672c-cfd3-4b1b-bd48-ebab7bfffdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:44.732296 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27672c-cfd3-4b1b-bd48-ebab7bfffdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:44.752203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3e27672c-cfd3-4b1b-bd48-ebab7bfffdf5 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:44.753397 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3e27672c-cfd3-4b1b-bd48-ebab7bfffdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:44.811991 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1400/2823] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:24:44.822185 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:44.823654 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:44.881910 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4975-1dbe-4840-a3c8-2aef031ac178 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:44.886404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04256-4d39-4c4a-a792-bb14647a24df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:44.887069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04256-4d39-4c4a-a792-bb14647a24df service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:44.887346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04256-4d39-4c4a-a792-bb14647a24df service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:44.887613 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04256-4d39-4c4a-a792-bb14647a24df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:44.899214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04256-4d39-4c4a-a792-bb14647a24df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:44.900642 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04256-4d39-4c4a-a792-bb14647a24df service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:44.909976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1424/2824] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:45.173007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27672c-cfd3-4b1b-bd48-ebab7bfffdf5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:45.174471 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3e27672c-cfd3-4b1b-bd48-ebab7bfffdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:45.187038 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27672c-cfd3-4b1b-bd48-ebab7bfffdf5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:45.191617 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:45.192235 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:45.192511 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:45.192779 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] PATH_INFO: `/v3/projects/126c1c48d90f4a759276ded94e49d715` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:45.194022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=126c1c48d90f4a759276ded94e49d715)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:45.195998 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:45.242061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126c1c48d90f4a759276ded94e49d715', 'request_id': 'req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.247704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126c1c48d90f4a759276ded94e49d715', 'request_id': 'req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.253763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126c1c48d90f4a759276ded94e49d715', 'request_id': 'req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.266070 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] The token cache is being invalidate because project 126c1c48d90f4a759276ded94e49d715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:24:45.266356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.267001 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.268493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1401/2825] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:24:45 2022] DELETE /identity/v3/projects/126c1c48d90f4a759276ded94e49d715 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:45.272530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04256-4d39-4c4a-a792-bb14647a24df service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:45.281943 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04256-4d39-4c4a-a792-bb14647a24df service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:45.299990 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:45.339566 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:45.340201 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:45.340481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:45.340782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] PATH_INFO: `/v3/users/46cfa9db9f3241ffbfa3f71e24b0f9b7` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:45.341946 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46cfa9db9f3241ffbfa3f71e24b0f9b7)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:45.343941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:45.388093 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46cfa9db9f3241ffbfa3f71e24b0f9b7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.388666 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46cfa9db9f3241ffbfa3f71e24b0f9b7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.395917 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46cfa9db9f3241ffbfa3f71e24b0f9b7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.408150 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46cfa9db9f3241ffbfa3f71e24b0f9b7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.408771 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-de094aed-b2cc-4523-9491-89a2b838f2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46cfa9db9f3241ffbfa3f71e24b0f9b7'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.421100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1425/2826] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:24:45 2022] DELETE /identity/v3/users/46cfa9db9f3241ffbfa3f71e24b0f9b7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:45.688360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:45.689883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:45.703743 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae6cbb-4fa7-4e93-8568-d4d33b319f58 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:45.761823 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:45.762491 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:45.762765 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:45.763038 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] PATH_INFO: `/v3/projects/e0286520513047fb9de74670fd8f5ac6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:45.764192 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0286520513047fb9de74670fd8f5ac6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:45.766166 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:45.796602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:45.814575 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0286520513047fb9de74670fd8f5ac6', 'request_id': 'req-a3396136-9f9a-494d-9723-4419453839dd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.820467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0286520513047fb9de74670fd8f5ac6', 'request_id': 'req-a3396136-9f9a-494d-9723-4419453839dd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.826421 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0286520513047fb9de74670fd8f5ac6', 'request_id': 'req-a3396136-9f9a-494d-9723-4419453839dd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.838967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] The token cache is being invalidate because project e0286520513047fb9de74670fd8f5ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:24:45.839250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.839865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a3396136-9f9a-494d-9723-4419453839dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:45.841341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1402/2827] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:24:45 2022] DELETE /identity/v3/projects/e0286520513047fb9de74670fd8f5ac6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:45.846190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269c78-391b-459e-98af-e5c81071ea5d None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:45.846705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269c78-391b-459e-98af-e5c81071ea5d None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:45.846801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269c78-391b-459e-98af-e5c81071ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:45.867030 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-df269c78-391b-459e-98af-e5c81071ea5d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:45.868217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-df269c78-391b-459e-98af-e5c81071ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:45.926764 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1426/2828] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:45.934356 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0804a13-e25b-4827-a9e6-5267eb3e691b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:45.934612 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0804a13-e25b-4827-a9e6-5267eb3e691b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:45.934883 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0804a13-e25b-4827-a9e6-5267eb3e691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:45.956391 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f0804a13-e25b-4827-a9e6-5267eb3e691b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:45.957744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f0804a13-e25b-4827-a9e6-5267eb3e691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:45.968108 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1403/2829] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:45.972417 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269c78-391b-459e-98af-e5c81071ea5d None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:45.982282 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269c78-391b-459e-98af-e5c81071ea5d None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:45.986857 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46225a06-d37c-443c-9970-5e317b5b325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:45.987487 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225a06-d37c-443c-9970-5e317b5b325e admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:45.987768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225a06-d37c-443c-9970-5e317b5b325e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:45.988041 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225a06-d37c-443c-9970-5e317b5b325e admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:45.988735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46225a06-d37c-443c-9970-5e317b5b325e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:24:45.989038 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46225a06-d37c-443c-9970-5e317b5b325e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:45.990665 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46225a06-d37c-443c-9970-5e317b5b325e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.002008 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1427/2830] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:24:46.006672 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0804a13-e25b-4827-a9e6-5267eb3e691b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.015817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0804a13-e25b-4827-a9e6-5267eb3e691b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.020405 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcf462-58d7-4552-adf0-a9396ee76596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.020993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcf462-58d7-4552-adf0-a9396ee76596 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.021262 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcf462-58d7-4552-adf0-a9396ee76596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.021526 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcf462-58d7-4552-adf0-a9396ee76596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.022755 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcf462-58d7-4552-adf0-a9396ee76596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.024632 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcf462-58d7-4552-adf0-a9396ee76596 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.051334 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1404/2831] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:24:46 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:46.055470 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46225a06-d37c-443c-9970-5e317b5b325e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.065567 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46225a06-d37c-443c-9970-5e317b5b325e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.091207 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:46.122476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dce04-9ca6-479c-8668-c4389ead533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.123080 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dce04-9ca6-479c-8668-c4389ead533e admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.123355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dce04-9ca6-479c-8668-c4389ead533e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.123621 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dce04-9ca6-479c-8668-c4389ead533e admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.124283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dce04-9ca6-479c-8668-c4389ead533e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.126186 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dce04-9ca6-479c-8668-c4389ead533e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.145792 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1428/2832] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:24:46 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:46.149925 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcf462-58d7-4552-adf0-a9396ee76596 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.160168 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcf462-58d7-4552-adf0-a9396ee76596 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.164864 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b852-6d14-451f-9bcd-52fd13a079b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.165464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b852-6d14-451f-9bcd-52fd13a079b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.165744 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b852-6d14-451f-9bcd-52fd13a079b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.166016 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b852-6d14-451f-9bcd-52fd13a079b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.166751 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239b852-6d14-451f-9bcd-52fd13a079b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.168353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239b852-6d14-451f-9bcd-52fd13a079b1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.178676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1405/2833] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:46.182390 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dce04-9ca6-479c-8668-c4389ead533e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.192348 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dce04-9ca6-479c-8668-c4389ead533e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.197427 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd73a2-d5af-423d-834f-c0a6b652634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.198010 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd73a2-d5af-423d-834f-c0a6b652634b admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.198287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd73a2-d5af-423d-834f-c0a6b652634b admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.198598 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd73a2-d5af-423d-834f-c0a6b652634b admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.199290 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd73a2-d5af-423d-834f-c0a6b652634b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.200861 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd73a2-d5af-423d-834f-c0a6b652634b admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.211111 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1429/2834] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:46.215151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b852-6d14-451f-9bcd-52fd13a079b1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.225290 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b852-6d14-451f-9bcd-52fd13a079b1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.229838 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726db7eb-1e5b-4904-ad70-8c5f0c1bdecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.230504 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726db7eb-1e5b-4904-ad70-8c5f0c1bdecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.230781 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726db7eb-1e5b-4904-ad70-8c5f0c1bdecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.231049 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726db7eb-1e5b-4904-ad70-8c5f0c1bdecd admin admin] PATH_INFO: `/v3/projects/ae9ea582a763449a9439c352aa941e55/users/59712c202fd945c29f5dd3b5b5bd78b0/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.245596 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726db7eb-1e5b-4904-ad70-8c5f0c1bdecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9ea582a763449a9439c352aa941e55, user_id=59712c202fd945c29f5dd3b5b5bd78b0, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.248236 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726db7eb-1e5b-4904-ad70-8c5f0c1bdecd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.261310 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1406/2835] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:46 2022] PUT /identity/v3/projects/ae9ea582a763449a9439c352aa941e55/users/59712c202fd945c29f5dd3b5b5bd78b0/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:46.271170 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119d9c2-2ec4-4500-849a-1b5b13ad943b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.271479 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119d9c2-2ec4-4500-849a-1b5b13ad943b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.271751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119d9c2-2ec4-4500-849a-1b5b13ad943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.298091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d119d9c2-2ec4-4500-849a-1b5b13ad943b None None] MFA Rules not processed for user `59712c202fd945c29f5dd3b5b5bd78b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:46.299377 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d119d9c2-2ec4-4500-849a-1b5b13ad943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:46.372676 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1430/2836] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:46.377267 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726db7eb-1e5b-4904-ad70-8c5f0c1bdecd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.438102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726db7eb-1e5b-4904-ad70-8c5f0c1bdecd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.442843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1bc9c-7426-421c-9e31-e4c45b981cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.443393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1bc9c-7426-421c-9e31-e4c45b981cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.444324 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1bc9c-7426-421c-9e31-e4c45b981cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.444609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1bc9c-7426-421c-9e31-e4c45b981cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.445276 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1bc9c-7426-421c-9e31-e4c45b981cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.447210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1bc9c-7426-421c-9e31-e4c45b981cb0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.473258 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1407/2837] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:24:46 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:46.477811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119d9c2-2ec4-4500-849a-1b5b13ad943b None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.488339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119d9c2-2ec4-4500-849a-1b5b13ad943b None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.542382 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51f342-1437-4184-8472-34e3bbf45939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.543100 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51f342-1437-4184-8472-34e3bbf45939 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.543404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51f342-1437-4184-8472-34e3bbf45939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.543678 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51f342-1437-4184-8472-34e3bbf45939 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.544365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51f342-1437-4184-8472-34e3bbf45939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.546268 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51f342-1437-4184-8472-34e3bbf45939 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.567436 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1431/2838] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:24:46 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:46.571443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1bc9c-7426-421c-9e31-e4c45b981cb0 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.581721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1bc9c-7426-421c-9e31-e4c45b981cb0 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.586255 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76b98b-e877-4220-aa11-c4699f39ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.586892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b98b-e877-4220-aa11-c4699f39ae59 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.587165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b98b-e877-4220-aa11-c4699f39ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.587434 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b98b-e877-4220-aa11-c4699f39ae59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.588118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76b98b-e877-4220-aa11-c4699f39ae59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.589690 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76b98b-e877-4220-aa11-c4699f39ae59 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.600493 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1408/2839] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:46.604346 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51f342-1437-4184-8472-34e3bbf45939 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.614187 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51f342-1437-4184-8472-34e3bbf45939 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.619438 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df39ba6-c53e-4410-abc2-62dee2344e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.620031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39ba6-c53e-4410-abc2-62dee2344e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.620314 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39ba6-c53e-4410-abc2-62dee2344e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.620603 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39ba6-c53e-4410-abc2-62dee2344e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.621312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df39ba6-c53e-4410-abc2-62dee2344e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.622941 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df39ba6-c53e-4410-abc2-62dee2344e21 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.632682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1432/2840] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:46.636849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76b98b-e877-4220-aa11-c4699f39ae59 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.653969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76b98b-e877-4220-aa11-c4699f39ae59 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.658658 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35beda2-ff82-4f51-8b5a-86b2626043d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.659316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35beda2-ff82-4f51-8b5a-86b2626043d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.659597 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35beda2-ff82-4f51-8b5a-86b2626043d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.659869 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35beda2-ff82-4f51-8b5a-86b2626043d4 admin admin] PATH_INFO: `/v3/projects/6d4d8a8dfe854e55ab133a6012d508b2/users/22dc80d25a294ceb93c10d5810b3f50e/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.674854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35beda2-ff82-4f51-8b5a-86b2626043d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4d8a8dfe854e55ab133a6012d508b2, user_id=22dc80d25a294ceb93c10d5810b3f50e, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.677497 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35beda2-ff82-4f51-8b5a-86b2626043d4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.687061 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:46.692360 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1409/2841] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:46 2022] PUT /identity/v3/projects/6d4d8a8dfe854e55ab133a6012d508b2/users/22dc80d25a294ceb93c10d5810b3f50e/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:24:46.703871 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece744b-c303-4613-977b-663e2b47cb89 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.704098 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece744b-c303-4613-977b-663e2b47cb89 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.704377 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece744b-c303-4613-977b-663e2b47cb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.731877 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-4ece744b-c303-4613-977b-663e2b47cb89 None None] MFA Rules not processed for user `22dc80d25a294ceb93c10d5810b3f50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:46.733083 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-4ece744b-c303-4613-977b-663e2b47cb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:46.736971 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:46.798715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1433/2842] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:46.803742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35beda2-ff82-4f51-8b5a-86b2626043d4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.864837 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35beda2-ff82-4f51-8b5a-86b2626043d4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.869473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc80ef-fbb0-4084-8a21-a1ddfbfb78ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.870085 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc80ef-fbb0-4084-8a21-a1ddfbfb78ec admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.870363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc80ef-fbb0-4084-8a21-a1ddfbfb78ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.870677 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc80ef-fbb0-4084-8a21-a1ddfbfb78ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.871337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc80ef-fbb0-4084-8a21-a1ddfbfb78ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.873242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc80ef-fbb0-4084-8a21-a1ddfbfb78ec admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.899602 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1410/2843] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:24:46 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:46.903645 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece744b-c303-4613-977b-663e2b47cb89 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:46.915158 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece744b-c303-4613-977b-663e2b47cb89 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:46.971402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b914757-9ff6-4066-b33c-9195631f821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:46.971940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b914757-9ff6-4066-b33c-9195631f821f admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:46.972463 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b914757-9ff6-4066-b33c-9195631f821f admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:46.972781 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b914757-9ff6-4066-b33c-9195631f821f admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:46.973447 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b914757-9ff6-4066-b33c-9195631f821f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:46.976061 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b914757-9ff6-4066-b33c-9195631f821f admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:46.996769 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1434/2844] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:24:46 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:47.000904 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc80ef-fbb0-4084-8a21-a1ddfbfb78ec admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:47.011113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc80ef-fbb0-4084-8a21-a1ddfbfb78ec admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:47.015711 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757fbac-8559-4236-a01d-b9d814cf58a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:47.016313 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757fbac-8559-4236-a01d-b9d814cf58a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:47.016594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757fbac-8559-4236-a01d-b9d814cf58a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:47.016866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757fbac-8559-4236-a01d-b9d814cf58a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:47.017554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757fbac-8559-4236-a01d-b9d814cf58a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:47.019217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757fbac-8559-4236-a01d-b9d814cf58a6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:47.030080 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1411/2845] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:47.034043 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b914757-9ff6-4066-b33c-9195631f821f admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:47.044810 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b914757-9ff6-4066-b33c-9195631f821f admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:47.049430 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054af1-8d61-4359-8c3d-9fa1e18d29bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:47.050104 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054af1-8d61-4359-8c3d-9fa1e18d29bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:47.050383 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054af1-8d61-4359-8c3d-9fa1e18d29bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:47.050693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054af1-8d61-4359-8c3d-9fa1e18d29bd admin admin] PATH_INFO: `/v3/projects/dd827752f57f4866a7e57081189cfe53/users/62c695de8bdc464b807c57874711221e/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:47.065396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1054af1-8d61-4359-8c3d-9fa1e18d29bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd827752f57f4866a7e57081189cfe53, user_id=62c695de8bdc464b807c57874711221e, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:47.068103 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1054af1-8d61-4359-8c3d-9fa1e18d29bd admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:47.081408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1435/2846] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:47 2022] PUT /identity/v3/projects/dd827752f57f4866a7e57081189cfe53/users/62c695de8bdc464b807c57874711221e/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:47.085748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757fbac-8559-4236-a01d-b9d814cf58a6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:47.095537 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757fbac-8559-4236-a01d-b9d814cf58a6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:47.150783 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c49626-d003-4a3f-80ea-2cd064d08f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:47.151393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c49626-d003-4a3f-80ea-2cd064d08f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:47.151668 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c49626-d003-4a3f-80ea-2cd064d08f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:47.151938 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c49626-d003-4a3f-80ea-2cd064d08f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:47.152620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c49626-d003-4a3f-80ea-2cd064d08f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:47.154229 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c49626-d003-4a3f-80ea-2cd064d08f52 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:47.164469 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1412/2847] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:47.168530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054af1-8d61-4359-8c3d-9fa1e18d29bd admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:47.178544 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054af1-8d61-4359-8c3d-9fa1e18d29bd admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:47.183053 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661be90-7459-4ab2-a0bb-f8b3b3db2b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:47.183685 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661be90-7459-4ab2-a0bb-f8b3b3db2b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:47.183966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661be90-7459-4ab2-a0bb-f8b3b3db2b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:47.184240 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661be90-7459-4ab2-a0bb-f8b3b3db2b8d admin admin] PATH_INFO: `/v3/projects/dd827752f57f4866a7e57081189cfe53/users/62c695de8bdc464b807c57874711221e/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:47.186392 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661be90-7459-4ab2-a0bb-f8b3b3db2b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd827752f57f4866a7e57081189cfe53, user_id=62c695de8bdc464b807c57874711221e, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:47.189035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661be90-7459-4ab2-a0bb-f8b3b3db2b8d admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:47.199434 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1436/2848] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:47 2022] PUT /identity/v3/projects/dd827752f57f4866a7e57081189cfe53/users/62c695de8bdc464b807c57874711221e/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:47.209117 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718484bb-36ae-40d4-a45d-de822259d0b4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:47.209970 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718484bb-36ae-40d4-a45d-de822259d0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:47.210249 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718484bb-36ae-40d4-a45d-de822259d0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:47.237022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-718484bb-36ae-40d4-a45d-de822259d0b4 None None] MFA Rules not processed for user `62c695de8bdc464b807c57874711221e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:47.238139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-718484bb-36ae-40d4-a45d-de822259d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:47.296884 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:47.307026 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1413/2849] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:47.318408 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661be90-7459-4ab2-a0bb-f8b3b3db2b8d admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:47.320640 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-9661be90-7459-4ab2-a0bb-f8b3b3db2b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:47.376454 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661be90-7459-4ab2-a0bb-f8b3b3db2b8d admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:47.380027 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a79b3a-5761-4a6d-8779-e4b171199e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:47.380710 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a79b3a-5761-4a6d-8779-e4b171199e9c service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:47.380986 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a79b3a-5761-4a6d-8779-e4b171199e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:47.381776 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a79b3a-5761-4a6d-8779-e4b171199e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:47.390712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a79b3a-5761-4a6d-8779-e4b171199e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:47.392127 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a79b3a-5761-4a6d-8779-e4b171199e9c service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:47.397734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:47.402879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1437/2850] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:47.442364 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718484bb-36ae-40d4-a45d-de822259d0b4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:47.444329 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-718484bb-36ae-40d4-a45d-de822259d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:47.456382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718484bb-36ae-40d4-a45d-de822259d0b4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:47.460588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7461c-35ba-4559-af0c-d52c7cab0540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:47.461189 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7461c-35ba-4559-af0c-d52c7cab0540 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:47.461473 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7461c-35ba-4559-af0c-d52c7cab0540 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:47.461737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7461c-35ba-4559-af0c-d52c7cab0540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:47.516106 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7461c-35ba-4559-af0c-d52c7cab0540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:47.517460 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7461c-35ba-4559-af0c-d52c7cab0540 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:47.526800 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1414/2851] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:50.383517 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a79b3a-5761-4a6d-8779-e4b171199e9c service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:50.443381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a79b3a-5761-4a6d-8779-e4b171199e9c service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:50.448342 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:50.448961 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:50.449241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:50.449514 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] PATH_INFO: `/v3/users/59712c202fd945c29f5dd3b5b5bd78b0` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:50.450700 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59712c202fd945c29f5dd3b5b5bd78b0)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:50.452641 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:50.497105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59712c202fd945c29f5dd3b5b5bd78b0'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:50.497745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59712c202fd945c29f5dd3b5b5bd78b0'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:50.505031 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59712c202fd945c29f5dd3b5b5bd78b0'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:50.517279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59712c202fd945c29f5dd3b5b5bd78b0'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:50.517899 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59712c202fd945c29f5dd3b5b5bd78b0'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:50.532286 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1438/2852] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:24:50 2022] DELETE /identity/v3/users/59712c202fd945c29f5dd3b5b5bd78b0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:50.535283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5bd82-aad5-432b-b8c3-8e710aa30b3a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:50.535770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5bd82-aad5-432b-b8c3-8e710aa30b3a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:50.535875 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5bd82-aad5-432b-b8c3-8e710aa30b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:50.556072 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5bf5bd82-aad5-432b-b8c3-8e710aa30b3a None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:50.557265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5bf5bd82-aad5-432b-b8c3-8e710aa30b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:50.614119 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1415/2853] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:50.623677 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:50.625138 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:50.681312 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6bda5-3e84-49b3-a01f-331bf4b25799 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:50.684927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130e13-8272-44ad-ace3-2b8889f87ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:50.685523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130e13-8272-44ad-ace3-2b8889f87ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:50.686054 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130e13-8272-44ad-ace3-2b8889f87ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:50.686326 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130e13-8272-44ad-ace3-2b8889f87ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:50.695509 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7130e13-8272-44ad-ace3-2b8889f87ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:50.696879 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7130e13-8272-44ad-ace3-2b8889f87ef9 service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:50.706248 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1439/2854] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:50.976756 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5bd82-aad5-432b-b8c3-8e710aa30b3a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:50.978169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5bf5bd82-aad5-432b-b8c3-8e710aa30b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:50.989934 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5bd82-aad5-432b-b8c3-8e710aa30b3a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:50.994942 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:50.995587 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:50.995865 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:50.996136 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] PATH_INFO: `/v3/projects/ae9ea582a763449a9439c352aa941e55` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:50.997362 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9ea582a763449a9439c352aa941e55)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:51.000635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:51.048989 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9ea582a763449a9439c352aa941e55', 'request_id': 'req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.054502 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9ea582a763449a9439c352aa941e55', 'request_id': 'req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.060527 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9ea582a763449a9439c352aa941e55', 'request_id': 'req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.073278 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] The token cache is being invalidate because project ae9ea582a763449a9439c352aa941e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:24:51.073565 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.074194 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.075757 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1416/2855] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:24:50 2022] DELETE /identity/v3/projects/ae9ea582a763449a9439c352aa941e55 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:51.079757 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130e13-8272-44ad-ace3-2b8889f87ef9 service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:51.089979 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130e13-8272-44ad-ace3-2b8889f87ef9 service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:51.107499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:51.147252 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:51.147938 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:51.148218 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:51.148533 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] PATH_INFO: `/v3/users/22dc80d25a294ceb93c10d5810b3f50e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:51.149782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=22dc80d25a294ceb93c10d5810b3f50e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:51.151820 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:51.196745 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22dc80d25a294ceb93c10d5810b3f50e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.197402 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22dc80d25a294ceb93c10d5810b3f50e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.205653 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22dc80d25a294ceb93c10d5810b3f50e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.218182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22dc80d25a294ceb93c10d5810b3f50e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.218823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22dc80d25a294ceb93c10d5810b3f50e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.231035 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1440/2856] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:24:51 2022] DELETE /identity/v3/users/22dc80d25a294ceb93c10d5810b3f50e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:51.499017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:51.500524 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:51.513919 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b7e9a-8811-445e-95b1-0b66fe281b7e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:51.526792 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:51.573748 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:51.574399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:51.574678 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:51.574952 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] PATH_INFO: `/v3/projects/6d4d8a8dfe854e55ab133a6012d508b2` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:51.576096 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4d8a8dfe854e55ab133a6012d508b2)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:51.578000 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:51.622647 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4d8a8dfe854e55ab133a6012d508b2', 'request_id': 'req-da784c73-fc9f-4aa2-b4c9-e35039923ad7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.628021 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4d8a8dfe854e55ab133a6012d508b2', 'request_id': 'req-da784c73-fc9f-4aa2-b4c9-e35039923ad7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.634644 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4d8a8dfe854e55ab133a6012d508b2', 'request_id': 'req-da784c73-fc9f-4aa2-b4c9-e35039923ad7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.646607 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] The token cache is being invalidate because project 6d4d8a8dfe854e55ab133a6012d508b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:24:51.646894 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.647525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.649017 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1417/2857] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:24:51 2022] DELETE /identity/v3/projects/6d4d8a8dfe854e55ab133a6012d508b2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:51.653182 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:51.655155 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:51.668112 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b733e0-3d85-4195-aa48-abd02ad3fc1e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:51.730425 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:51.731090 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:51.731387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:51.731638 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] PATH_INFO: `/v3/users/62c695de8bdc464b807c57874711221e` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:51.732788 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c695de8bdc464b807c57874711221e)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:51.734734 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:51.778287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:51.781665 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c695de8bdc464b807c57874711221e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.782477 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c695de8bdc464b807c57874711221e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.791177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c695de8bdc464b807c57874711221e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.802789 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c695de8bdc464b807c57874711221e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.803975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-3c7b1495-8980-4af9-abed-43f89cd58bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c695de8bdc464b807c57874711221e'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:51.816052 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1441/2858] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:24:51 2022] DELETE /identity/v3/users/62c695de8bdc464b807c57874711221e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:52.087604 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:52.089074 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:52.102660 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da784c73-fc9f-4aa2-b4c9-e35039923ad7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:52.159429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:52.160003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.160281 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.160554 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] PATH_INFO: `/v3/projects/dd827752f57f4866a7e57081189cfe53` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.161713 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd827752f57f4866a7e57081189cfe53)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:52.164246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:52.208571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd827752f57f4866a7e57081189cfe53', 'request_id': 'req-3d7e0e08-9151-48aa-90aa-c36999cfde65'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:52.210261 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:52.215424 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd827752f57f4866a7e57081189cfe53', 'request_id': 'req-3d7e0e08-9151-48aa-90aa-c36999cfde65'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:52.223217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd827752f57f4866a7e57081189cfe53', 'request_id': 'req-3d7e0e08-9151-48aa-90aa-c36999cfde65'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:52.235490 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] The token cache is being invalidate because project dd827752f57f4866a7e57081189cfe53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:24:52.235770 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:52.236383 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d7e0e08-9151-48aa-90aa-c36999cfde65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:52.237901 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1418/2859] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:24:52 2022] DELETE /identity/v3/projects/dd827752f57f4866a7e57081189cfe53 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:52.244755 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cad0f-ee8c-4107-9425-ba2ca7356820 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.245040 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cad0f-ee8c-4107-9425-ba2ca7356820 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.245316 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cad0f-ee8c-4107-9425-ba2ca7356820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.264227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-d73cad0f-ee8c-4107-9425-ba2ca7356820 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:52.265410 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-d73cad0f-ee8c-4107-9425-ba2ca7356820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:52.322253 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1442/2860] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:52.331939 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07bb4-9cab-4a4c-8949-6e4eb9a55966 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.332223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07bb4-9cab-4a4c-8949-6e4eb9a55966 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.332496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07bb4-9cab-4a4c-8949-6e4eb9a55966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.352547 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f2c07bb4-9cab-4a4c-8949-6e4eb9a55966 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:52.353733 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f2c07bb4-9cab-4a4c-8949-6e4eb9a55966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:52.361993 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1419/2861] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:52.366088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cad0f-ee8c-4107-9425-ba2ca7356820 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:52.377916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cad0f-ee8c-4107-9425-ba2ca7356820 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:52.382705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b8f2f-009b-4184-9fae-0e1e6b92b8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:52.383448 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b8f2f-009b-4184-9fae-0e1e6b92b8bd admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.383735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b8f2f-009b-4184-9fae-0e1e6b92b8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.384152 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b8f2f-009b-4184-9fae-0e1e6b92b8bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.384804 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b8f2f-009b-4184-9fae-0e1e6b92b8bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:24:52.385115 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b8f2f-009b-4184-9fae-0e1e6b92b8bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:52.386770 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b8f2f-009b-4184-9fae-0e1e6b92b8bd admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:52.401164 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1443/2862] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:24:52.405588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07bb4-9cab-4a4c-8949-6e4eb9a55966 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:52.415525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07bb4-9cab-4a4c-8949-6e4eb9a55966 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:52.420151 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed3280-c064-4456-9e41-35c8720be920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:52.420752 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3280-c064-4456-9e41-35c8720be920 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.421036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3280-c064-4456-9e41-35c8720be920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.421312 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3280-c064-4456-9e41-35c8720be920 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.421967 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed3280-c064-4456-9e41-35c8720be920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:52.423905 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed3280-c064-4456-9e41-35c8720be920 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:52.451217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1420/2863] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:24:52 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:52.455243 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b8f2f-009b-4184-9fae-0e1e6b92b8bd admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:52.465751 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b8f2f-009b-4184-9fae-0e1e6b92b8bd admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:52.519635 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042822c-7d20-43ea-a4d8-d91caec8a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:52.520236 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042822c-7d20-43ea-a4d8-d91caec8a734 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.520515 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042822c-7d20-43ea-a4d8-d91caec8a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.520790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042822c-7d20-43ea-a4d8-d91caec8a734 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.521458 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042822c-7d20-43ea-a4d8-d91caec8a734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:52.523939 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042822c-7d20-43ea-a4d8-d91caec8a734 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:52.545078 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1444/2864] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:24:52 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:52.549190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed3280-c064-4456-9e41-35c8720be920 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:52.559760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed3280-c064-4456-9e41-35c8720be920 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:52.564650 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa72e9-ab74-434c-bf7b-071e655cec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:52.565246 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa72e9-ab74-434c-bf7b-071e655cec1f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.565525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa72e9-ab74-434c-bf7b-071e655cec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.565794 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa72e9-ab74-434c-bf7b-071e655cec1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.566521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa72e9-ab74-434c-bf7b-071e655cec1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:52.568095 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa72e9-ab74-434c-bf7b-071e655cec1f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:52.578412 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1421/2865] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:52.582069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042822c-7d20-43ea-a4d8-d91caec8a734 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:52.592481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042822c-7d20-43ea-a4d8-d91caec8a734 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:52.597050 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b7ead-7e07-4cfb-9c69-6b3839750fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:52.597647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b7ead-7e07-4cfb-9c69-6b3839750fae admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.597926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b7ead-7e07-4cfb-9c69-6b3839750fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.598200 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b7ead-7e07-4cfb-9c69-6b3839750fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.598935 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b7ead-7e07-4cfb-9c69-6b3839750fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:52.600538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b7ead-7e07-4cfb-9c69-6b3839750fae admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:52.610875 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1445/2866] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:52.614854 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa72e9-ab74-434c-bf7b-071e655cec1f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:52.624718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa72e9-ab74-434c-bf7b-071e655cec1f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:52.629458 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316454cd-bbbd-4462-9f97-16c2ce545445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:52.630103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316454cd-bbbd-4462-9f97-16c2ce545445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.630379 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316454cd-bbbd-4462-9f97-16c2ce545445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.630686 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316454cd-bbbd-4462-9f97-16c2ce545445 admin admin] PATH_INFO: `/v3/projects/b8bafb9c07fb48d5b0c0c800570f10a2/users/3b078f9fadbd4193ab6a681005ffd53a/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.645571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316454cd-bbbd-4462-9f97-16c2ce545445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bafb9c07fb48d5b0c0c800570f10a2, user_id=3b078f9fadbd4193ab6a681005ffd53a, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:52.648824 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316454cd-bbbd-4462-9f97-16c2ce545445 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:52.661399 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1422/2867] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:52 2022] PUT /identity/v3/projects/b8bafb9c07fb48d5b0c0c800570f10a2/users/3b078f9fadbd4193ab6a681005ffd53a/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:52.672966 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869e61-35ac-4c2f-92d2-f45d83e0f43c None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.673426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869e61-35ac-4c2f-92d2-f45d83e0f43c None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.673542 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869e61-35ac-4c2f-92d2-f45d83e0f43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.702024 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-25869e61-35ac-4c2f-92d2-f45d83e0f43c None None] MFA Rules not processed for user `3b078f9fadbd4193ab6a681005ffd53a`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:52.703285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-25869e61-35ac-4c2f-92d2-f45d83e0f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:52.716193 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:52.769016 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1446/2868] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:52.774161 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316454cd-bbbd-4462-9f97-16c2ce545445 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:52.836435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316454cd-bbbd-4462-9f97-16c2ce545445 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:52.841283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5dad-9185-4df1-942f-f00a60f82d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:52.841892 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5dad-9185-4df1-942f-f00a60f82d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.842174 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5dad-9185-4df1-942f-f00a60f82d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.842467 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5dad-9185-4df1-942f-f00a60f82d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.843133 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5dad-9185-4df1-942f-f00a60f82d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:52.845030 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5dad-9185-4df1-942f-f00a60f82d67 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:52.872796 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1423/2869] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:24:52 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:52.876851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25869e61-35ac-4c2f-92d2-f45d83e0f43c None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:52.887999 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25869e61-35ac-4c2f-92d2-f45d83e0f43c None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:52.943245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b8618-df02-412e-b5ec-5e45d133a1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:52.944376 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b8618-df02-412e-b5ec-5e45d133a1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.944657 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b8618-df02-412e-b5ec-5e45d133a1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.944927 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b8618-df02-412e-b5ec-5e45d133a1c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.945577 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b8618-df02-412e-b5ec-5e45d133a1c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:52.947523 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b8618-df02-412e-b5ec-5e45d133a1c4 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:52.967754 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1447/2870] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:24:52 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:52.971820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5dad-9185-4df1-942f-f00a60f82d67 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:52.982099 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5dad-9185-4df1-942f-f00a60f82d67 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:52.986841 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253126d8-7ff1-4b92-9680-1cd1c8a92b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:52.987454 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253126d8-7ff1-4b92-9680-1cd1c8a92b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:52.987737 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253126d8-7ff1-4b92-9680-1cd1c8a92b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:52.988010 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253126d8-7ff1-4b92-9680-1cd1c8a92b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:52.988702 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253126d8-7ff1-4b92-9680-1cd1c8a92b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:52.990817 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253126d8-7ff1-4b92-9680-1cd1c8a92b0b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:53.001209 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1424/2871] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:53.005097 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b8618-df02-412e-b5ec-5e45d133a1c4 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:53.015832 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b8618-df02-412e-b5ec-5e45d133a1c4 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:53.020393 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da0379-ba04-43e5-af94-92e6856d8c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:53.021042 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0379-ba04-43e5-af94-92e6856d8c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:53.021324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0379-ba04-43e5-af94-92e6856d8c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:53.022119 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0379-ba04-43e5-af94-92e6856d8c85 admin admin] PATH_INFO: `/v3/projects/2b27cd2ec73c419c99011defe6998369/users/90c552d177dc44f7a3132a57fad559bb/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:53.036400 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da0379-ba04-43e5-af94-92e6856d8c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b27cd2ec73c419c99011defe6998369, user_id=90c552d177dc44f7a3132a57fad559bb, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:53.039627 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da0379-ba04-43e5-af94-92e6856d8c85 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:53.052092 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1448/2872] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:53 2022] PUT /identity/v3/projects/2b27cd2ec73c419c99011defe6998369/users/90c552d177dc44f7a3132a57fad559bb/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:24:53.056203 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253126d8-7ff1-4b92-9680-1cd1c8a92b0b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:53.066347 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253126d8-7ff1-4b92-9680-1cd1c8a92b0b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:53.110516 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:53.123592 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743170e-634b-4a93-bca6-96dc4da36ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:53.124210 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743170e-634b-4a93-bca6-96dc4da36ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:53.124490 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743170e-634b-4a93-bca6-96dc4da36ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:53.124763 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743170e-634b-4a93-bca6-96dc4da36ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:53.125479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743170e-634b-4a93-bca6-96dc4da36ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:53.127165 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743170e-634b-4a93-bca6-96dc4da36ac2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:53.136873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1425/2873] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:53.140960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da0379-ba04-43e5-af94-92e6856d8c85 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:53.151696 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da0379-ba04-43e5-af94-92e6856d8c85 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:53.156858 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3480b-242a-4a7b-84e1-e9929bec962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:53.157508 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3480b-242a-4a7b-84e1-e9929bec962e admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:53.157790 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3480b-242a-4a7b-84e1-e9929bec962e admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:53.158062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3480b-242a-4a7b-84e1-e9929bec962e admin admin] PATH_INFO: `/v3/projects/2b27cd2ec73c419c99011defe6998369/users/90c552d177dc44f7a3132a57fad559bb/roles/2ea26ef62c144a6698a8e8f249e74409` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:53.160059 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3480b-242a-4a7b-84e1-e9929bec962e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b27cd2ec73c419c99011defe6998369, user_id=90c552d177dc44f7a3132a57fad559bb, role_id=2ea26ef62c144a6698a8e8f249e74409)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:53.163364 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3480b-242a-4a7b-84e1-e9929bec962e admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:53.173419 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1449/2874] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:53 2022] PUT /identity/v3/projects/2b27cd2ec73c419c99011defe6998369/users/90c552d177dc44f7a3132a57fad559bb/roles/2ea26ef62c144a6698a8e8f249e74409 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:53.183615 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12dc59-3c25-4c7d-8c16-9a1f9ac95a3e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:53.183902 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12dc59-3c25-4c7d-8c16-9a1f9ac95a3e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:53.184177 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12dc59-3c25-4c7d-8c16-9a1f9ac95a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:53.213443 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7c12dc59-3c25-4c7d-8c16-9a1f9ac95a3e None None] MFA Rules not processed for user `90c552d177dc44f7a3132a57fad559bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:53.214679 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7c12dc59-3c25-4c7d-8c16-9a1f9ac95a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:53.280721 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1426/2875] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:53.291934 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3480b-242a-4a7b-84e1-e9929bec962e admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:53.293631 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-bac3480b-242a-4a7b-84e1-e9929bec962e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:53.350728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3480b-242a-4a7b-84e1-e9929bec962e admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:53.354355 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e14fc5-45b1-4616-a0fe-58fa596e7b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:53.354983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14fc5-45b1-4616-a0fe-58fa596e7b42 service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:53.355264 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14fc5-45b1-4616-a0fe-58fa596e7b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:53.355538 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14fc5-45b1-4616-a0fe-58fa596e7b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:53.374842 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:53.411855 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e14fc5-45b1-4616-a0fe-58fa596e7b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:53.413295 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e14fc5-45b1-4616-a0fe-58fa596e7b42 service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:53.422081 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1450/2876] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:55.950479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12dc59-3c25-4c7d-8c16-9a1f9ac95a3e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:56.011637 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12dc59-3c25-4c7d-8c16-9a1f9ac95a3e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:56.016163 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:56.016795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:56.017073 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:56.017343 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] PATH_INFO: `/v3/users/3b078f9fadbd4193ab6a681005ffd53a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:56.018512 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b078f9fadbd4193ab6a681005ffd53a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:56.020428 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:56.066571 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b078f9fadbd4193ab6a681005ffd53a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.067479 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b078f9fadbd4193ab6a681005ffd53a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.074833 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b078f9fadbd4193ab6a681005ffd53a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.086492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b078f9fadbd4193ab6a681005ffd53a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.087120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b078f9fadbd4193ab6a681005ffd53a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.088307 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:56.101492 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1427/2877] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:24:55 2022] DELETE /identity/v3/users/3b078f9fadbd4193ab6a681005ffd53a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:56.105976 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d172b24-c3f5-4983-8d94-a30a35ca7cd9 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:56.106571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d172b24-c3f5-4983-8d94-a30a35ca7cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:56.106571 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d172b24-c3f5-4983-8d94-a30a35ca7cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:56.125256 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-0d172b24-c3f5-4983-8d94-a30a35ca7cd9 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:56.126449 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0d172b24-c3f5-4983-8d94-a30a35ca7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:56.183172 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1451/2878] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:56.193068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:56.195076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:56.251048 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ad1d7-6939-47c7-bfaf-9954ff0ef018 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:56.254610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78357540-d419-4dbd-b590-e60adc45a64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:56.255217 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78357540-d419-4dbd-b590-e60adc45a64e service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:56.255496 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78357540-d419-4dbd-b590-e60adc45a64e service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:56.255787 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78357540-d419-4dbd-b590-e60adc45a64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:56.264629 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78357540-d419-4dbd-b590-e60adc45a64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:56.266042 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78357540-d419-4dbd-b590-e60adc45a64e service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:56.275363 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1428/2879] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:56.545970 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d172b24-c3f5-4983-8d94-a30a35ca7cd9 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:56.548165 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0d172b24-c3f5-4983-8d94-a30a35ca7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:56.561105 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d172b24-c3f5-4983-8d94-a30a35ca7cd9 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:56.565703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:56.566334 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:56.566647 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:56.566928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] PATH_INFO: `/v3/projects/b8bafb9c07fb48d5b0c0c800570f10a2` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:56.568145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8bafb9c07fb48d5b0c0c800570f10a2)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:56.570607 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:56.617139 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8bafb9c07fb48d5b0c0c800570f10a2', 'request_id': 'req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.624478 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8bafb9c07fb48d5b0c0c800570f10a2', 'request_id': 'req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.630009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8bafb9c07fb48d5b0c0c800570f10a2', 'request_id': 'req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.641443 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] The token cache is being invalidate because project b8bafb9c07fb48d5b0c0c800570f10a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:24:56.641728 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.642353 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.643873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1452/2880] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:24:56 2022] DELETE /identity/v3/projects/b8bafb9c07fb48d5b0c0c800570f10a2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:56.648441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78357540-d419-4dbd-b590-e60adc45a64e service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:56.658014 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78357540-d419-4dbd-b590-e60adc45a64e service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:56.713239 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:56.713866 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:56.714153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:56.714426 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] PATH_INFO: `/v3/users/90c552d177dc44f7a3132a57fad559bb` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:56.715655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c552d177dc44f7a3132a57fad559bb)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:56.717563 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:56.764879 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c552d177dc44f7a3132a57fad559bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.765529 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c552d177dc44f7a3132a57fad559bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.772285 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c552d177dc44f7a3132a57fad559bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.784182 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c552d177dc44f7a3132a57fad559bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.784840 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9185cb1b-6635-4a37-b53b-3509afbeb2b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c552d177dc44f7a3132a57fad559bb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:56.796787 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1429/2881] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:24:56 2022] DELETE /identity/v3/users/90c552d177dc44f7a3132a57fad559bb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:57.073671 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:57.075362 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:57.090324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb8da9-a83c-44c3-a0ee-4a90e973c7fb admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:57.134163 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:57.148863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:57.149499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.149782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.150055 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] PATH_INFO: `/v3/projects/2b27cd2ec73c419c99011defe6998369` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.151241 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b27cd2ec73c419c99011defe6998369)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:57.153169 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:57.198242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b27cd2ec73c419c99011defe6998369', 'request_id': 'req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:57.204606 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b27cd2ec73c419c99011defe6998369', 'request_id': 'req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:57.210133 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b27cd2ec73c419c99011defe6998369', 'request_id': 'req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:57.221500 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] The token cache is being invalidate because project 2b27cd2ec73c419c99011defe6998369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:24:57.221782 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:57.222397 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-9d485b62-12cb-4a39-97cb-c67ea1cf8b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:24:57.223885 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1453/2882] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:24:57 2022] DELETE /identity/v3/projects/2b27cd2ec73c419c99011defe6998369 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:57.230380 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfc9e1-0341-44ff-8201-494bec472b1d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.230879 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfc9e1-0341-44ff-8201-494bec472b1d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.231076 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfc9e1-0341-44ff-8201-494bec472b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.255033 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-facfc9e1-0341-44ff-8201-494bec472b1d None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:57.256242 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-facfc9e1-0341-44ff-8201-494bec472b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:57.261652 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:57.317961 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1430/2883] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:57.327144 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8674571-653c-4a76-85d2-120820a34da6 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.327431 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8674571-653c-4a76-85d2-120820a34da6 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.327704 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8674571-653c-4a76-85d2-120820a34da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.348190 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f8674571-653c-4a76-85d2-120820a34da6 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:57.349380 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f8674571-653c-4a76-85d2-120820a34da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:57.357605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1454/2884] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:57.361806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfc9e1-0341-44ff-8201-494bec472b1d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:57.371494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfc9e1-0341-44ff-8201-494bec472b1d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:57.375966 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da840b09-9fbe-443c-80ea-7e7ccec8b2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:57.376572 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da840b09-9fbe-443c-80ea-7e7ccec8b2aa admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.376848 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da840b09-9fbe-443c-80ea-7e7ccec8b2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.377118 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da840b09-9fbe-443c-80ea-7e7ccec8b2aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.377803 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da840b09-9fbe-443c-80ea-7e7ccec8b2aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 02:24:57.378103 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da840b09-9fbe-443c-80ea-7e7ccec8b2aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:57.379729 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da840b09-9fbe-443c-80ea-7e7ccec8b2aa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:57.391002 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1431/2885] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Jul 28 02:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 02:24:57.395217 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8674571-653c-4a76-85d2-120820a34da6 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:57.404975 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8674571-653c-4a76-85d2-120820a34da6 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:57.409682 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc874-9383-46f6-9ab2-24b4e3f01827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:57.410279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc874-9383-46f6-9ab2-24b4e3f01827 admin admin] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.410605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc874-9383-46f6-9ab2-24b4e3f01827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.411009 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc874-9383-46f6-9ab2-24b4e3f01827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.411714 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cc874-9383-46f6-9ab2-24b4e3f01827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:57.414266 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cc874-9383-46f6-9ab2-24b4e3f01827 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:57.440940 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1455/2886] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Jul 28 02:24:57 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 02:24:57.445041 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da840b09-9fbe-443c-80ea-7e7ccec8b2aa admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:57.454999 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da840b09-9fbe-443c-80ea-7e7ccec8b2aa admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:57.510849 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26243f6e-454d-4ed4-b28a-24282028a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:57.511456 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26243f6e-454d-4ed4-b28a-24282028a776 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.511736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26243f6e-454d-4ed4-b28a-24282028a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.512007 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26243f6e-454d-4ed4-b28a-24282028a776 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.512655 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26243f6e-454d-4ed4-b28a-24282028a776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:57.514577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26243f6e-454d-4ed4-b28a-24282028a776 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:57.534844 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1432/2887] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Jul 28 02:24:57 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 02:24:57.539705 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc874-9383-46f6-9ab2-24b4e3f01827 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:57.550343 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc874-9383-46f6-9ab2-24b4e3f01827 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:57.555310 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173ee2b-a708-410d-8697-e4e5486830c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:57.555921 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ee2b-a708-410d-8697-e4e5486830c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.556203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ee2b-a708-410d-8697-e4e5486830c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.556476 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ee2b-a708-410d-8697-e4e5486830c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.557203 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173ee2b-a708-410d-8697-e4e5486830c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:57.558843 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173ee2b-a708-410d-8697-e4e5486830c1 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:57.569549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1456/2888] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 02:24:57.573536 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26243f6e-454d-4ed4-b28a-24282028a776 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:57.583355 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26243f6e-454d-4ed4-b28a-24282028a776 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:57.588635 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a959307-3d6e-47b9-9e14-a6614be30261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:57.589240 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a959307-3d6e-47b9-9e14-a6614be30261 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.589521 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a959307-3d6e-47b9-9e14-a6614be30261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.589795 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a959307-3d6e-47b9-9e14-a6614be30261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.590515 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a959307-3d6e-47b9-9e14-a6614be30261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:57.592130 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a959307-3d6e-47b9-9e14-a6614be30261 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:57.603393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1433/2889] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Jul 28 02:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 02:24:57.607245 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173ee2b-a708-410d-8697-e4e5486830c1 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:57.617005 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173ee2b-a708-410d-8697-e4e5486830c1 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:57.621574 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb601e-4cb6-4b09-aadb-0659fcd8a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:57.622208 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb601e-4cb6-4b09-aadb-0659fcd8a586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.622529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb601e-4cb6-4b09-aadb-0659fcd8a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.622806 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb601e-4cb6-4b09-aadb-0659fcd8a586 admin admin] PATH_INFO: `/v3/projects/106714164aab4141bce442abb65f56c4/users/e4d165ffecf24eafa9e6f89b9df1c876/roles/55fc2032ca914d2fb1ec5cbd52f60e54` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.636867 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb601e-4cb6-4b09-aadb-0659fcd8a586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106714164aab4141bce442abb65f56c4, user_id=e4d165ffecf24eafa9e6f89b9df1c876, role_id=55fc2032ca914d2fb1ec5cbd52f60e54)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:57.639572 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb601e-4cb6-4b09-aadb-0659fcd8a586 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:57.653404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1457/2890] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Jul 28 02:24:57 2022] PUT /identity/v3/projects/106714164aab4141bce442abb65f56c4/users/e4d165ffecf24eafa9e6f89b9df1c876/roles/55fc2032ca914d2fb1ec5cbd52f60e54 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:24:57.658212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9f239-db0f-4f4c-94e8-ff84faaeebc4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.658530 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9f239-db0f-4f4c-94e8-ff84faaeebc4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.658806 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9f239-db0f-4f4c-94e8-ff84faaeebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.677745 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-55d9f239-db0f-4f4c-94e8-ff84faaeebc4 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:57.679006 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-55d9f239-db0f-4f4c-94e8-ff84faaeebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:57.737008 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1434/2891] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:57.747766 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb601e-4cb6-4b09-aadb-0659fcd8a586 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:57.750616 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-edbb601e-4cb6-4b09-aadb-0659fcd8a586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:57.810983 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb601e-4cb6-4b09-aadb-0659fcd8a586 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:57.814648 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114534b-3534-4f3f-a11d-249b9d0e614d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:57.815260 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114534b-3534-4f3f-a11d-249b9d0e614d service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:57.815545 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114534b-3534-4f3f-a11d-249b9d0e614d service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:57.815821 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114534b-3534-4f3f-a11d-249b9d0e614d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:57.825461 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114534b-3534-4f3f-a11d-249b9d0e614d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:57.826886 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114534b-3534-4f3f-a11d-249b9d0e614d service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:57.836805 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1458/2892] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:58.461393 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e370-9493-4037-abec-55b4ef0ebcf0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:58.461951 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e370-9493-4037-abec-55b4ef0ebcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:58.462060 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e370-9493-4037-abec-55b4ef0ebcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:58.490283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9853e370-9493-4037-abec-55b4ef0ebcf0 None None] MFA Rules not processed for user `e4d165ffecf24eafa9e6f89b9df1c876`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:24:58.492070 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9853e370-9493-4037-abec-55b4ef0ebcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:58.497214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:58.560609 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1435/2893] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:24:58.571768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114534b-3534-4f3f-a11d-249b9d0e614d service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:24:58.573277 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7114534b-3534-4f3f-a11d-249b9d0e614d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:24:58.591529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:58.632549 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114534b-3534-4f3f-a11d-249b9d0e614d service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:24:58.636157 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cd6d9-1337-4fea-9b38-575522f62fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983bd6880830419f9158b33411b57f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:24:58.636768 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cd6d9-1337-4fea-9b38-575522f62fcb service cinder] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:58.637048 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cd6d9-1337-4fea-9b38-575522f62fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:58.637322 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cd6d9-1337-4fea-9b38-575522f62fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:24:58.645743 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cd6d9-1337-4fea-9b38-575522f62fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:24:58.647227 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cd6d9-1337-4fea-9b38-575522f62fcb service cinder] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:24:58.655956 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1459/2894] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:24:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:24:59.995988 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b074cf-db7a-4e1e-8afa-ee95f2afdc48 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:24:59.996501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b074cf-db7a-4e1e-8afa-ee95f2afdc48 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:24:59.996610 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b074cf-db7a-4e1e-8afa-ee95f2afdc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:00.015101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-80b074cf-db7a-4e1e-8afa-ee95f2afdc48 None None] MFA Rules not processed for user `e4d165ffecf24eafa9e6f89b9df1c876`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:25:00.016289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-80b074cf-db7a-4e1e-8afa-ee95f2afdc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:00.023116 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1436/2895] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:24:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:25:00.063962 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cd6d9-1337-4fea-9b38-575522f62fcb service cinder] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:00.065349 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c27cd6d9-1337-4fea-9b38-575522f62fcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:00.141284 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cd6d9-1337-4fea-9b38-575522f62fcb service cinder] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:00.144802 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2e7c-3079-4021-a5e3-806717a251d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece4e0b16a9441b5ba14bbc8ff1c632c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:00.145401 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2e7c-3079-4021-a5e3-806717a251d1 service glance] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:00.145679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2e7c-3079-4021-a5e3-806717a251d1 service glance] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:00.145951 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2e7c-3079-4021-a5e3-806717a251d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:00.147670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-262d2e7c-3079-4021-a5e3-806717a251d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:00.216297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d2e7c-3079-4021-a5e3-806717a251d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:00.217715 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d2e7c-3079-4021-a5e3-806717a251d1 service glance] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:00.228724 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1460/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:00.427178 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b074cf-db7a-4e1e-8afa-ee95f2afdc48 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:00.437525 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b074cf-db7a-4e1e-8afa-ee95f2afdc48 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:00.441120 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7f355-d532-48fa-8dac-006a30b53cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:00.441723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7f355-d532-48fa-8dac-006a30b53cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:00.442036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7f355-d532-48fa-8dac-006a30b53cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:00.442306 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7f355-d532-48fa-8dac-006a30b53cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:00.444638 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8df7f355-d532-48fa-8dac-006a30b53cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:00.453944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7f355-d532-48fa-8dac-006a30b53cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:00.455396 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7f355-d532-48fa-8dac-006a30b53cfd service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:00.463301 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1437/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:00.791920 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2e7c-3079-4021-a5e3-806717a251d1 service glance] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:00.801387 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2e7c-3079-4021-a5e3-806717a251d1 service glance] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:00.805823 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48431d-3eb2-4ea0-af1b-29e1194bef9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:00.806553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48431d-3eb2-4ea0-af1b-29e1194bef9f service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:00.806995 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48431d-3eb2-4ea0-af1b-29e1194bef9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:00.807339 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48431d-3eb2-4ea0-af1b-29e1194bef9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:00.809181 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2f48431d-3eb2-4ea0-af1b-29e1194bef9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:00.823421 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48431d-3eb2-4ea0-af1b-29e1194bef9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:00.824851 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48431d-3eb2-4ea0-af1b-29e1194bef9f service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:00.835960 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1461/2898] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:02.680283 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7f355-d532-48fa-8dac-006a30b53cfd service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:02.689265 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7f355-d532-48fa-8dac-006a30b53cfd service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:02.692867 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edf193-0aeb-498b-a101-be887c421e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:02.693464 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edf193-0aeb-498b-a101-be887c421e49 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:02.693741 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edf193-0aeb-498b-a101-be887c421e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:02.694601 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edf193-0aeb-498b-a101-be887c421e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:02.696353 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-04edf193-0aeb-498b-a101-be887c421e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:02.705701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edf193-0aeb-498b-a101-be887c421e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:02.707124 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edf193-0aeb-498b-a101-be887c421e49 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:02.715068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1438/2899] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:10.831068 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=88 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:12.711475 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=39 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:29.392683 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7ac3e-0ff2-4d4f-a233-2dcd94abaeb7 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:29.393242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7ac3e-0ff2-4d4f-a233-2dcd94abaeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:29.393242 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7ac3e-0ff2-4d4f-a233-2dcd94abaeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:29.412637 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-c4f7ac3e-0ff2-4d4f-a233-2dcd94abaeb7 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:25:29.414369 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-c4f7ac3e-0ff2-4d4f-a233-2dcd94abaeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:29.422616 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1462/2900] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:25:29.445927 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edf193-0aeb-498b-a101-be887c421e49 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:29.448036 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-04edf193-0aeb-498b-a101-be887c421e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:29.463772 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edf193-0aeb-498b-a101-be887c421e49 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:29.469169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7b8c9-6691-47fb-984f-bf9af59e5ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:29.469791 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7b8c9-6691-47fb-984f-bf9af59e5ec2 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:29.470068 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7b8c9-6691-47fb-984f-bf9af59e5ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:29.470342 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7b8c9-6691-47fb-984f-bf9af59e5ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:29.478341 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7b8c9-6691-47fb-984f-bf9af59e5ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:29.479930 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7b8c9-6691-47fb-984f-bf9af59e5ec2 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:29.489167 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1439/2901] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:32.453952 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa692a-6328-48e5-b8a3-924d644354fd None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:32.454481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa692a-6328-48e5-b8a3-924d644354fd None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:32.454481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa692a-6328-48e5-b8a3-924d644354fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:32.473250 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-f8fa692a-6328-48e5-b8a3-924d644354fd None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:25:32.474585 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-f8fa692a-6328-48e5-b8a3-924d644354fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:32.482670 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1463/2902] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:25:32.503760 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7b8c9-6691-47fb-984f-bf9af59e5ec2 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:32.505169 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0ff7b8c9-6691-47fb-984f-bf9af59e5ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:32.520839 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7b8c9-6691-47fb-984f-bf9af59e5ec2 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:32.530750 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25d577-05c4-4b59-a78d-02d9f6fea521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:32.531723 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25d577-05c4-4b59-a78d-02d9f6fea521 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:32.532011 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25d577-05c4-4b59-a78d-02d9f6fea521 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:32.532289 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25d577-05c4-4b59-a78d-02d9f6fea521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:32.544122 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25d577-05c4-4b59-a78d-02d9f6fea521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:32.545696 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25d577-05c4-4b59-a78d-02d9f6fea521 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:32.555908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1440/2903] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:35.703418 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc093-7401-44dd-be8d-da9537445b37 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:35.703954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc093-7401-44dd-be8d-da9537445b37 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:35.703954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc093-7401-44dd-be8d-da9537445b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:35.723023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-a44bc093-7401-44dd-be8d-da9537445b37 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:25:35.724254 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-a44bc093-7401-44dd-be8d-da9537445b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:35.732701 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1464/2904] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:25:35.752501 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25d577-05c4-4b59-a78d-02d9f6fea521 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:35.763742 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25d577-05c4-4b59-a78d-02d9f6fea521 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:35.769221 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0754812-f691-4ffb-9c7a-b0664da77b81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:35.769815 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754812-f691-4ffb-9c7a-b0664da77b81 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:35.770100 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754812-f691-4ffb-9c7a-b0664da77b81 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:35.770369 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754812-f691-4ffb-9c7a-b0664da77b81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:35.778429 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0754812-f691-4ffb-9c7a-b0664da77b81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:35.780019 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0754812-f691-4ffb-9c7a-b0664da77b81 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:35.789831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1441/2905] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:38.793324 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9468c-c812-4e57-a0be-51e4063e468b None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:38.793799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9468c-c812-4e57-a0be-51e4063e468b None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:38.793932 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9468c-c812-4e57-a0be-51e4063e468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:38.813896 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-eed9468c-c812-4e57-a0be-51e4063e468b None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:25:38.815145 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-eed9468c-c812-4e57-a0be-51e4063e468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:38.822964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1465/2906] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:25:38.843003 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0754812-f691-4ffb-9c7a-b0664da77b81 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:38.854814 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0754812-f691-4ffb-9c7a-b0664da77b81 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:38.860435 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80f44e-c0e9-4b67-929f-d018080a8c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:38.861034 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80f44e-c0e9-4b67-929f-d018080a8c54 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:38.861316 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80f44e-c0e9-4b67-929f-d018080a8c54 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:38.861590 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80f44e-c0e9-4b67-929f-d018080a8c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:38.870577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80f44e-c0e9-4b67-929f-d018080a8c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:38.872139 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80f44e-c0e9-4b67-929f-d018080a8c54 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:38.881661 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1442/2907] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:42.981874 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3960cc-9d88-4898-812b-7bafd43c0fc8 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:42.982510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3960cc-9d88-4898-812b-7bafd43c0fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:42.982510 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3960cc-9d88-4898-812b-7bafd43c0fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:43.002873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-7b3960cc-9d88-4898-812b-7bafd43c0fc8 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:25:43.004489 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-7b3960cc-9d88-4898-812b-7bafd43c0fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:43.012156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1466/2908] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:25:43.035725 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80f44e-c0e9-4b67-929f-d018080a8c54 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:43.048102 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80f44e-c0e9-4b67-929f-d018080a8c54 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:43.053730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca415b-24bb-4dcb-a0d2-8e0b9d5bcda2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:43.054944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca415b-24bb-4dcb-a0d2-8e0b9d5bcda2 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:43.055223 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca415b-24bb-4dcb-a0d2-8e0b9d5bcda2 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:43.055494 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca415b-24bb-4dcb-a0d2-8e0b9d5bcda2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:43.064207 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca415b-24bb-4dcb-a0d2-8e0b9d5bcda2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:43.065793 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca415b-24bb-4dcb-a0d2-8e0b9d5bcda2 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:43.075828 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1443/2909] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:46.144693 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cd278-5102-4e53-9beb-0f3fad8cc415 None None] REQUEST_METHOD: `POST` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:46.145177 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cd278-5102-4e53-9beb-0f3fad8cc415 None None] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:46.145279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cd278-5102-4e53-9beb-0f3fad8cc415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:46.165699 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.auth.core [None req-263cd278-5102-4e53-9beb-0f3fad8cc415 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:25:46.166916 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-263cd278-5102-4e53-9beb-0f3fad8cc415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:46.174719 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1467/2910] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:25:46.195420 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca415b-24bb-4dcb-a0d2-8e0b9d5bcda2 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:46.209337 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca415b-24bb-4dcb-a0d2-8e0b9d5bcda2 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:46.215190 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8f9f-ddf9-4522-82ae-a4e6eab08607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:46.215797 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8f9f-ddf9-4522-82ae-a4e6eab08607 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:46.216077 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8f9f-ddf9-4522-82ae-a4e6eab08607 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:46.216346 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8f9f-ddf9-4522-82ae-a4e6eab08607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:46.224465 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8f9f-ddf9-4522-82ae-a4e6eab08607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:46.226588 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8f9f-ddf9-4522-82ae-a4e6eab08607 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:46.236899 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1444/2911] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:56.115287 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cd278-5102-4e53-9beb-0f3fad8cc415 None None] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:25:56.123151 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=19 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:56.129811 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cd278-5102-4e53-9beb-0f3fad8cc415 None None] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:25:56.135283 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c479a7f-1266-4cd9-9ac1-1c1ae545cdce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:25:56.135926 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c479a7f-1266-4cd9-9ac1-1c1ae545cdce service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:25:56.136209 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c479a7f-1266-4cd9-9ac1-1c1ae545cdce service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:25:56.136481 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c479a7f-1266-4cd9-9ac1-1c1ae545cdce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:25:56.138270 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-8c479a7f-1266-4cd9-9ac1-1c1ae545cdce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:25:56.152457 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c479a7f-1266-4cd9-9ac1-1c1ae545cdce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:25:56.154069 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c479a7f-1266-4cd9-9ac1-1c1ae545cdce service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:25:56.165337 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1468/2912] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:25:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:25:56.231704 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=36 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:01.219701 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4670aea-c71b-4103-a0ac-96d8e5ef7eaf None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:01.220259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4670aea-c71b-4103-a0ac-96d8e5ef7eaf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:01.220259 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4670aea-c71b-4103-a0ac-96d8e5ef7eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:01.238558 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d4670aea-c71b-4103-a0ac-96d8e5ef7eaf None None] MFA Rules not processed for user `e4d165ffecf24eafa9e6f89b9df1c876`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:26:01.239734 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d4670aea-c71b-4103-a0ac-96d8e5ef7eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:26:01.246382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1445/2913] 10.222.0.36 () {58 vars in 958 bytes} [Thu Jul 28 02:26:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:26:01.482025 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c479a7f-1266-4cd9-9ac1-1c1ae545cdce service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:26:01.492000 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c479a7f-1266-4cd9-9ac1-1c1ae545cdce service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:26:01.495623 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0338bde-c028-4ba3-8f2a-115d9cb2eaad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bf5763fbf94aa9b438a1be6ce88c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:26:01.496223 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338bde-c028-4ba3-8f2a-115d9cb2eaad service neutron] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:01.496496 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338bde-c028-4ba3-8f2a-115d9cb2eaad service neutron] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:01.496763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338bde-c028-4ba3-8f2a-115d9cb2eaad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:01.498490 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-b0338bde-c028-4ba3-8f2a-115d9cb2eaad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:26:01.508551 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0338bde-c028-4ba3-8f2a-115d9cb2eaad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:26:01.509964 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0338bde-c028-4ba3-8f2a-115d9cb2eaad service neutron] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:26:01.517986 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1469/2914] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:26:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:26:01.827300 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4670aea-c71b-4103-a0ac-96d8e5ef7eaf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:26:01.829457 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d4670aea-c71b-4103-a0ac-96d8e5ef7eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:26:01.905846 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4670aea-c71b-4103-a0ac-96d8e5ef7eaf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:26:01.910826 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a1eeb-176c-4935-94ff-3f034b0888b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:26:01.911441 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a1eeb-176c-4935-94ff-3f034b0888b3 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:01.911717 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a1eeb-176c-4935-94ff-3f034b0888b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:01.911987 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a1eeb-176c-4935-94ff-3f034b0888b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:01.914226 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0f8a1eeb-176c-4935-94ff-3f034b0888b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:26:01.925594 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a1eeb-176c-4935-94ff-3f034b0888b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:26:01.927214 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a1eeb-176c-4935-94ff-3f034b0888b3 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:26:01.937842 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1446/2915] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:26:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:26:10.426365 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0338bde-c028-4ba3-8f2a-115d9cb2eaad service neutron] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:26:10.440354 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0338bde-c028-4ba3-8f2a-115d9cb2eaad service neutron] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:26:10.445984 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970d17f-027e-477d-a684-24070c1cb71a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:26:10.446706 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d17f-027e-477d-a684-24070c1cb71a service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:10.447062 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d17f-027e-477d-a684-24070c1cb71a service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:10.447406 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d17f-027e-477d-a684-24070c1cb71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:10.449247 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-2970d17f-027e-477d-a684-24070c1cb71a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:26:10.462214 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970d17f-027e-477d-a684-24070c1cb71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:26:10.463841 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970d17f-027e-477d-a684-24070c1cb71a service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:26:10.474953 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1470/2916] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:26:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:26:11.933358 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=35 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:15.268567 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a4537-93cc-44a4-b371-7a0177e4e3cb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:15.269213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a4537-93cc-44a4-b371-7a0177e4e3cb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:15.269213 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a4537-93cc-44a4-b371-7a0177e4e3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:15.289646 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-252a4537-93cc-44a4-b371-7a0177e4e3cb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:26:15.290954 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-252a4537-93cc-44a4-b371-7a0177e4e3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:26:15.298886 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1447/2917] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:26:15.317873 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970d17f-027e-477d-a684-24070c1cb71a service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:26:15.328987 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970d17f-027e-477d-a684-24070c1cb71a service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:26:15.334557 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a16f4-4e01-4e17-b2b6-cc43c8e4ba95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:26:15.335156 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a16f4-4e01-4e17-b2b6-cc43c8e4ba95 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:15.335433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a16f4-4e01-4e17-b2b6-cc43c8e4ba95 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:15.335703 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a16f4-4e01-4e17-b2b6-cc43c8e4ba95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:15.344530 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a16f4-4e01-4e17-b2b6-cc43c8e4ba95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:26:15.346089 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a16f4-4e01-4e17-b2b6-cc43c8e4ba95 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:26:15.355888 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1471/2918] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:26:18.534191 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947117d-4934-4575-a63e-16c161831961 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:18.534843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947117d-4934-4575-a63e-16c161831961 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:18.534843 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947117d-4934-4575-a63e-16c161831961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:18.553872 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f947117d-4934-4575-a63e-16c161831961 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:26:18.555096 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f947117d-4934-4575-a63e-16c161831961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:26:18.563101 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1448/2919] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:26:18.582839 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a16f4-4e01-4e17-b2b6-cc43c8e4ba95 service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:26:18.594661 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a16f4-4e01-4e17-b2b6-cc43c8e4ba95 service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:26:18.600056 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634bd27-80b6-46a7-82d9-77df9a9424b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:26:18.600650 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634bd27-80b6-46a7-82d9-77df9a9424b5 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:18.600928 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634bd27-80b6-46a7-82d9-77df9a9424b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:18.601198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634bd27-80b6-46a7-82d9-77df9a9424b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:18.609088 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634bd27-80b6-46a7-82d9-77df9a9424b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:26:18.610680 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634bd27-80b6-46a7-82d9-77df9a9424b5 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:26:18.619848 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1472/2920] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:26:21.619332 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0abc-51d4-45d3-9541-f0f0b90f8beb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:21.619820 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0abc-51d4-45d3-9541-f0f0b90f8beb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:21.619944 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0abc-51d4-45d3-9541-f0f0b90f8beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:21.639225 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-41ba0abc-51d4-45d3-9541-f0f0b90f8beb None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:26:21.640407 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-41ba0abc-51d4-45d3-9541-f0f0b90f8beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:26:21.648709 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1449/2921] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:26:21.668735 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634bd27-80b6-46a7-82d9-77df9a9424b5 service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:26:21.680620 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634bd27-80b6-46a7-82d9-77df9a9424b5 service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:26:21.686601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d52a-9bec-47f7-afa7-eaaef619b57a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:26:21.687198 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d52a-9bec-47f7-afa7-eaaef619b57a service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:21.687529 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d52a-9bec-47f7-afa7-eaaef619b57a service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:21.687838 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d52a-9bec-47f7-afa7-eaaef619b57a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:21.697049 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d52a-9bec-47f7-afa7-eaaef619b57a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:26:21.698651 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d52a-9bec-47f7-afa7-eaaef619b57a service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:26:21.707954 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1473/2922] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:26:24.780620 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dd78f-9e99-4223-a6da-26d05ebe1734 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:24.781153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dd78f-9e99-4223-a6da-26d05ebe1734 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:24.781153 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dd78f-9e99-4223-a6da-26d05ebe1734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:24.802043 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9c0dd78f-9e99-4223-a6da-26d05ebe1734 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:26:24.803297 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9c0dd78f-9e99-4223-a6da-26d05ebe1734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:26:24.811552 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1450/2923] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 02:26:24.834660 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d52a-9bec-47f7-afa7-eaaef619b57a service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:26:24.846278 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d52a-9bec-47f7-afa7-eaaef619b57a service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:26:24.852426 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d387ed-2da5-41ef-93d9-18fbeaf2c8a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:26:24.853023 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d387ed-2da5-41ef-93d9-18fbeaf2c8a8 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:24.853303 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d387ed-2da5-41ef-93d9-18fbeaf2c8a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:24.853579 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d387ed-2da5-41ef-93d9-18fbeaf2c8a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:24.862020 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d387ed-2da5-41ef-93d9-18fbeaf2c8a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:26:24.863698 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d387ed-2da5-41ef-93d9-18fbeaf2c8a8 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:26:24.873313 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1474/2924] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:26:28.956417 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca403b-f7af-436f-982a-8ddb6f3efe88 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:28.956916 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca403b-f7af-436f-982a-8ddb6f3efe88 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:28.957022 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca403b-f7af-436f-982a-8ddb6f3efe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:28.976212 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-75ca403b-f7af-436f-982a-8ddb6f3efe88 None None] MFA Rules not processed for user `e93e6c9ab9a14e7ebbf8568b323f951e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 02:26:28.977389 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-75ca403b-f7af-436f-982a-8ddb6f3efe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:26:28.985090 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1451/2925] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Jul 28 02:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 02:26:29.007817 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d387ed-2da5-41ef-93d9-18fbeaf2c8a8 service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:26:29.013605 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=42 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:29.020281 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d387ed-2da5-41ef-93d9-18fbeaf2c8a8 service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:26:29.025799 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235384a-bed2-4a72-97fe-0c2e0d53d9a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f911e716994f1f9d4705216ee0f3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:26:29.026404 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235384a-bed2-4a72-97fe-0c2e0d53d9a8 service nova] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:29.026725 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235384a-bed2-4a72-97fe-0c2e0d53d9a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:29.027001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235384a-bed2-4a72-97fe-0c2e0d53d9a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:29.035183 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235384a-bed2-4a72-97fe-0c2e0d53d9a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:26:29.036763 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235384a-bed2-4a72-97fe-0c2e0d53d9a8 service nova] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:26:29.046643 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1475/2926] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:26:38.970730 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=15 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:39.042499 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=5 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:59.913698 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca403b-f7af-436f-982a-8ddb6f3efe88 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:26:59.960831 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca403b-f7af-436f-982a-8ddb6f3efe88 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:26:59.969436 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfe3d0-5046-4859-9ade-aed9199b7dcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:26:59.969712 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235384a-bed2-4a72-97fe-0c2e0d53d9a8 service nova] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:26:59.970181 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfe3d0-5046-4859-9ade-aed9199b7dcd service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:26:59.970382 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfe3d0-5046-4859-9ade-aed9199b7dcd service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:26:59.970703 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfe3d0-5046-4859-9ade-aed9199b7dcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:26:59.972577 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e3bfe3d0-5046-4859-9ade-aed9199b7dcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:27:00.006863 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235384a-bed2-4a72-97fe-0c2e0d53d9a8 service nova] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:27:00.009250 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfe3d0-5046-4859-9ade-aed9199b7dcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:27:00.010873 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfe3d0-5046-4859-9ade-aed9199b7dcd service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:27:00.011601 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:27:00.012375 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:27:00.012723 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:27:00.013070 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] PATH_INFO: `/v3/users/e4d165ffecf24eafa9e6f89b9df1c876` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:27:00.014381 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d165ffecf24eafa9e6f89b9df1c876)` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:27:00.016433 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:27:00.020827 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1452/2927] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:26:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:27:00.064437 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d165ffecf24eafa9e6f89b9df1c876'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:27:00.065091 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d165ffecf24eafa9e6f89b9df1c876'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:27:00.073045 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d165ffecf24eafa9e6f89b9df1c876'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:27:00.085679 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d165ffecf24eafa9e6f89b9df1c876'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:27:00.086306 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.notifications [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d165ffecf24eafa9e6f89b9df1c876'} {{(pid=80077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:27:00.098297 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1476/2928] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Jul 28 02:26:59 2022] DELETE /identity/v3/users/e4d165ffecf24eafa9e6f89b9df1c876 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 02:27:00.264603 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfe3d0-5046-4859-9ade-aed9199b7dcd service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:27:00.278999 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfe3d0-5046-4859-9ade-aed9199b7dcd service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:27:00.335499 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e93e6c9ab9a14e7ebbf8568b323f951e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610fee5f9cbd481ca2b8410c0ec0c0c0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:27:00.336131 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:27:00.336406 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:27:00.336676 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] PATH_INFO: `/v3/projects/106714164aab4141bce442abb65f56c4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:27:00.337818 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106714164aab4141bce442abb65f56c4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:27:00.339736 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:27:00.384645 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106714164aab4141bce442abb65f56c4', 'request_id': 'req-6e526336-54da-4efa-a51f-75534ac59023'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:27:00.390110 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106714164aab4141bce442abb65f56c4', 'request_id': 'req-6e526336-54da-4efa-a51f-75534ac59023'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:27:00.396113 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106714164aab4141bce442abb65f56c4', 'request_id': 'req-6e526336-54da-4efa-a51f-75534ac59023'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:27:00.407624 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] The token cache is being invalidate because project 106714164aab4141bce442abb65f56c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 02:27:00.407908 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:27:00.408518 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6e526336-54da-4efa-a51f-75534ac59023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 02:27:00.409969 dv-cinder-799871-46-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1453/2929] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Jul 28 02:27:00 2022] DELETE /identity/v3/projects/106714164aab4141bce442abb65f56c4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 02:27:10.094801 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:27:10.404718 dv-cinder-799871-46-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:07.102872 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] Authenticating user token {{(pid=80077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 02:28:07.104280 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:28:07.190580 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f900c95-6c7e-4196-8c4e-bb8ecdc159b5 admin admin] Validating token access rules against request {{(pid=80077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 02:28:07.248396 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da11a7-5ead-42b8-afae-8b4f847c0ee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e041d38c69cd4626898bc1412f5ed1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03175c7be3f34efda54c3459e5ba94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 02:28:07.249001 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da11a7-5ead-42b8-afae-8b4f847c0ee7 service placement] REQUEST_METHOD: `GET` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 02:28:07.249279 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da11a7-5ead-42b8-afae-8b4f847c0ee7 service placement] SCRIPT_NAME: `/identity` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 02:28:07.249553 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da11a7-5ead-42b8-afae-8b4f847c0ee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 02:28:07.251285 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.fernet_utils [None req-97da11a7-5ead-42b8-afae-8b4f847c0ee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 02:28:07.262171 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da11a7-5ead-42b8-afae-8b4f847c0ee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 02:28:07.263773 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da11a7-5ead-42b8-afae-8b4f847c0ee7 service placement] RBAC: Authorization granted {{(pid=80077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 02:28:07.273982 dv-cinder-799871-46-smb devstack@keystone.service[80077]: [pid: 80077|app: 0|req: 1477/2930] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Jul 28 02:28:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 02:28:17.269345 dv-cinder-799871-46-smb devstack@keystone.service[80077]: DEBUG dbcounter [-] [80077] Writing DB stats keystone:SELECT=67 {{(pid=80077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}